Skip to content

GitLab

Explore

Sign in

Sglang

Project information

🔧🔗https://github.com/sgl-project/sglang

SGLang is a fast serving framework for large language models and vision language models.

cuda inference pytorch transformer moe Llama vlm Large Langua... llm-serving llava deepseek llama3

4,992 Commits
850 Branches
118 Tags

README
Apache License 2.0

Created on

March 16, 2025

Loading

🐾❤️ Strive to be the person your dogs believe you are ❤️🐾