llms

OpenLIT is an open-source LLM Observability tool built on OpenTelemetry. 📈🔥 Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions along with complete APM for LLM Apps. 🖥️

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API. https://github.com/Portkey-AI/gateway

https://github.com/InternLM/MindSearch 🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT) 🔗 https://mindsearch.netlify.app/

https://github.com/AI-Engineer-Foundation/agent-protocol Common interface for interacting with AI agents. The protocol is tech stack agnostic - you can use it with any framework for building agents.