L

Large Language Models

🔧🔗https://github.com/vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

🔧🔗https://github.com/tensorzero/tensorzero TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation

🔧🔗https://github.com/langfuse/langfuse-docs 🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground and metrics to debug and

🔧🔗https://github.com/openai/codex Lightweight coding agent that runs in your terminal

🔧🔗https://github.com/langfuse/langfuse 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, L

🔧🔗https://github.com/jingyaogong/minimind 🚀🚀 「大模型」2小时完全从0训练26M的小参数GPT！🌏 Train a 26M-parameter GPT from scratch in just 2h!

🔧🔗https://github.com/asgeirtj/system_prompts_leaks Collection of extracted System Prompts from popular chatbots like ChatGPT, Claude & Gemini

🔧🔗https://github.com/charmbracelet/crush The glamourous AI coding agent for your favourite terminal 💘

🔧🔗https://github.com/modelscope/ms-swift

SWIFT (Scalable lightWeight Infrastructure for Fine-Tuning) Use PEFT or Full-parameter to finetune 400+ LLMs or 100+ MLLMs.

🔧🔗https://github.com/modelscope/evalscope A streamlined and customizable framework for efficient large model evaluation and performance benchmarking

🔧🔗https://github.com/flashinfer-ai/flashinfer

FlashInfer: Kernel Library for LLM Serving

🕸️🔗flashinfer.ai

🔧🔗https://github.com/vllm-project/vllm-ascend Community maintained hardware plugin for vLLM on Ascend

🔧🔗https://github.com/getzep/graphiti

Build and query dynamic, temporally-aware Knowledge Graphs

🔧🔗https://github.com/charmbracelet/catwalk

🐈 A collection of LLM inference providers and models

🔧🔗https://github.com/BerriAI/litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq] 🕸️🔗docs.litellm.ai/docs/

🔧🔗https://github.com/Skyvern-AI/skyvern

Automate browser-based workflows with LLMs and Computer Vision 🕸️🔗 www.skyvern.com/

🔧🔗https://github.com/IBM/mcp-context-forge A Model Context Protocol (MCP) Gateway & Registry. Serves as a central management point for tools, resources, and prompts that can be accessed by MCP-compatible LLM applications. Converts REST API endpoints to MCP, composes virtual MCP servers with added security and observability, and converts between protocols (stdio, SSE, Streamable HTTP).

🔧🔗https://github.com/mendableai/firecrawl 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

🔧🔗https://github.com/open-webui/open-webui User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

🕸️🔗https://openwebui.com/

🔧🔗https://github.com/dyad-sh/dyad Free, local, open-source AI app builder ✨ v0 / lovable / Bolt alternative 🌟 Star if you like it!