Llama

🔧🔗https://github.com/sgl-project/sglang

SGLang is a fast serving framework for large language models and vision language models.

🔧🔗https://github.com/vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

🔧🔗https://github.com/tensorzero/tensorzero TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation

🔧🔗https://github.com/meta-llama/llama-stack

Composable building blocks to build Llama Apps

🔧🔗https://github.com/meta-llama/llama-stack-client-python

Python SDK for Llama Stack

🔧🔗https://github.com/hiyouga/LLaMA-Factory Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

https://github.com/InternLM/lmdeploy LMDeploy is a toolkit for compressing, deploying, and serving LLMs. 🔗 lmdeploy.readthedocs.io/en/latest/

🔧🔗https://github.com/modelscope/data-juicer Making data higher-quality, juicier, and more digestible for foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

🔧🔗https://github.com/modelscope/ms-swift

SWIFT (Scalable lightWeight Infrastructure for Fine-Tuning) Use PEFT or Full-parameter to finetune 400+ LLMs or 100+ MLLMs.

A multi-user ChatGPT for any LLMs and vector database. Unlimited documents, messages, and storage in one privacy-focused app. Now available as a desktop application with a built-in LLM!

🔧🔗https://github.com/meta-llama/llama-stack-client-node

NodeJS library for Llama Stack

🔧🔗https://github.com/meta-llama/llama-models

Utilities intended for use with Llama models.

Easy Edit

🔧🔗https://github.com/zjunlp/EasyEdit [ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

🔧🔗https://github.com/meta-llama/PurpleLlama

Set of tools to assess and improve LLM security.

Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

https://github.com/fishaudio/fish-speech Brand new TTS solution

https://github.com/arcee-ai/mergekit Tools for merging pretrained large language models.

🔧🔗https://github.com/andrewkchan/yalm

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

Dyad Mentor

🔧🔗https://github.com/dyad-sh/dyad-mentor Delightful AI coding mentor | Open-source, local, hackable | 🌟 Star if it sparks delight!

llama.cpp Connector

🔧🔗https://github.com/fidecastro/llama-cpp-connector Super simple Python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL, QVQ). Compile llama.cpp and run