Llm Compressor

Project information

🔧🔗https://github.com/vllm-project/llm-compressor Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

sparsity compression quantization vllm

2,695 Commits
649 Branches
15 Tags

README
Apache License 2.0
CONTRIBUTING

Created on

February 26, 2025

Loading

🐾❤️ Strive to be the person your dogs believe you are ❤️🐾