L

Large Language Models

🔧🔗https://github.com/tensorzero/tensorzero TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation

🔧🔗https://github.com/BerriAI/litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq] 🕸️🔗docs.litellm.ai/docs/

🔧🔗https://github.com/langfuse/langfuse 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, L

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.

🔧🔗https://github.com/iv-org/matrix-ai-moderator Matrix bot moderator that uses AI to ban new users sending inappropriate messages

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API. https://github.com/Portkey-AI/gateway

🔧🔗https://github.com/bytedance/deer-flow DeerFlow is a community-driven framework for Deep Research, combining language models with tools like web search, crawling, and Python execution, while contributing back to the open-source community.

Obsidian Vault LLM Assistant

🔧🔗https://github.com/brianstm/obsidian-vault-llm-assistant

An obsidian notebook plugin that uses LLM (OpenAI or Gemini) to answer questions and create new n

Dyad

🔧🔗https://github.com/dyad-sh/dyad Free, local, open-source AI app builder ✨ v0 / lovable / Bolt alternative 🌟 Star if you like it!

https://github.com/lmstudio-ai/lms LMStudio in your terminal https://lms.dev/

🔧🔗https://github.com/All-Hands-AI/OpenHands

🙌 OpenHands: Code Less, Make More

https://github.com/run-llama/LlamaIndexTS LlamaIndex is a data framework for your LLM applications

🔧🔗https://github.com/langfuse/langfuse-docs 🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground and metrics to debug and

https://github.com/distantmagic/paddler Stateful load balancer custom-tailored for llama.cpp

OpenLIT is an open-source LLM Observability tool built on OpenTelemetry. 📈🔥 Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions along with complete APM for LLM Apps. 🖥️

🔧🔗https://github.com/mem0ai/mem0 Memory for AI Agents; SOTA in AI Agent Memory; Announcing OpenMemory MCP - local and secure memory management.

🔧🔗https://github.com/HKUDS/LightRAG

"LightRAG: Simple and Fast Retrieval-Augmented Generation"

🔧🔗https://github.com/ihor-sokoliuk/mcp-searxng

This SearXNG MCP Server integrates the SearXNG API, providing web search capabilities.

Topics

https://github.com/mlc-ai/web-llm High-performance In-browser LLM Inference Engine

Obsidian Private AI

🔧🔗https://github.com/gabosgab/ObsidianPrivateAI A plugin for obsidian that makes it easy to interact with a local LLM