Llm Compressor

Project information

🔧🔗https://github.com/vllm-project/llm-compressor Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

sparsity compression quantization vllm

2,830 Commits
757 Branches
18 Tags

README
Apache License 2.0
CONTRIBUTING

Created on

February 26, 2025

Loading

🐾❤️ Strive to be the person your dogs believe you are ❤️🐾