V

vllm

🔧🔗https://github.com/vllm-project/aibrix Cost-efficient and pluggable Infrastructure components for GenAI inference

🔧🔗https://github.com/vllm-project/production-stack

Scale from single vLLM instance to distributed vLLM deployment without changing any application code.