Skip to content

GitLab

Explore

Sign in

Llm Compressor

Project information

🔧🔗https://github.com/vllm-project/llm-compressor Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

sparsity compression quantization vllm

2,672 Commits
631 Branches
15 Tags

README
Apache License 2.0
CONTRIBUTING

Created on

February 26, 2025

Loading

🐾❤️ Strive to be the person your dogs believe you are ❤️🐾