Lmdeploy

Project information

https://github.com/InternLM/lmdeploy LMDeploy is a toolkit for compressing, deploying, and serving LLMs. 🔗 lmdeploy.readthedocs.io/en/latest/

Llama cuda-kernels deepspeed Large Langua... fastertransf... llm-inference turbomind internlm llama2 codellama llama3

1,684 Commits
32 Branches
59 Tags

README
Apache License 2.0

Created on

August 14, 2024

Loading

🐾❤️ Strive to be the person your dogs believe you are ❤️🐾