V

vllm

🔧🔗https://github.com/vllm-project/production-stack

Scale from single vLLM instance to distributed vLLM deployment without changing any application code.

🔧🔗 meta-llama/llama-recipes Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs.