L

Large Language Models

https://github.com/InternLM/xtuner An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

🔧🔗https://github.com/tensorzero/tensorzero TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation

🔧🔗https://github.com/flashinfer-ai/flashinfer

FlashInfer: Kernel Library for LLM Serving

🕸️🔗flashinfer.ai

https://github.com/InternLM/lmdeploy LMDeploy is a toolkit for compressing, deploying, and serving LLMs. 🔗 lmdeploy.readthedocs.io/en/latest/

🔧🔗https://github.com/charmbracelet/catwalk

🐈 A collection of LLM inference providers and models

🔧🔗https://github.com/charmbracelet/crush The glamourous AI coding agent for your favourite terminal 💘

🔧🔗https://github.com/maragudk/gai-starter-kit Get started with LLMs, FTS and vector search, RAG, and more, in Go!

https://github.com/arcee-ai/DistillKit An Open Source Toolkit For LLM Distillation

🔧🔗https://github.com/mendableai/firecrawl 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

🔧🔗https://github.com/open-webui/open-webui User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

🕸️🔗https://openwebui.com/

🔧🔗https://github.com/dyad-sh/dyad Free, local, open-source AI app builder ✨ v0 / lovable / Bolt alternative 🌟 Star if you like it!

🔧🔗https://github.com/HKUDS/LightRAG

"LightRAG: Simple and Fast Retrieval-Augmented Generation"

https://github.com/run-llama/llama_index LlamaIndex is a data framework for your LLM applications

🔧🔗https://github.com/jingyaogong/minimind 🚀🚀 「大模型」2小时完全从0训练26M的小参数GPT！🌏 Train a 26M-parameter GPT from scratch in just 2h!

🔧🔗https://github.com/asgeirtj/system_prompts_leaks Collection of extracted System Prompts from popular chatbots like ChatGPT, Claude & Gemini

🔧🔗https://github.com/mem0ai/mem0 Memory for AI Agents; SOTA in AI Agent Memory; Announcing OpenMemory MCP - local and secure memory management.

🔧🔗https://github.com/bytedance/deer-flow DeerFlow is a community-driven framework for Deep Research, combining language models with tools like web search, crawling, and Python execution, while contributing back to the open-source community.

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure. burr.dagworks.io

https://github.com/joaomdmoura/crewAI Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

crewai.com

🔧🔗https://github.com/google/dotprompt Executable GenAI prompt templates