llms

OpenLIT is an open-source LLM Observability tool built on OpenTelemetry. 📈🔥 Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions along with complete APM for LLM Apps. 🖥️

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure. burr.dagworks.io

https://github.com/janhq/nitro.git now: https://github.com/janhq/cortex.git Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API. https://github.com/Portkey-AI/gateway

https://github.com/InternLM/MindSearch 🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT) 🔗 https://mindsearch.netlify.app/

https://github.com/joaomdmoura/crewAI Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

crewai.com

🔧🔗https://github.com/Cinnamon/kotaemon

An open-source RAG-based tool for chatting with your documents. 🕸️🔗https://cinnamon.github.io/kotaemon/

🔧🔗https://github.com/getzep/graphiti

Build and query dynamic, temporally-aware Knowledge Graphs

https://github.com/janhq/cortex Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

https://github.com/Lightning-AI/litgpt 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale. 🔗 https://lightning.ai/

https://github.com/AI-Engineer-Foundation/agent-protocol Common interface for interacting with AI agents. The protocol is tech stack agnostic - you can use it with any framework for building agents.

https://github.com/InternLM/OpenAOE LLM Group Chat Framework: chat with multiple LLMs at the same time. 大模型群聊框架：同时与多个大语言模型聊天。

Routes to the most performant and cost efficient LLM based on your prompt [ 🚧 WIP ]