llms
Projects with this topic
-
🔧 🔗 https://github.com/Cinnamon/kotaemonAn open-source RAG-based tool for chatting with your documents.
🕸 ️🔗 https://cinnamon.github.io/kotaemon/Updated -
https://github.com/janhq/cortex Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers
👋 JanUpdated -
https://github.com/janhq/nitro.git now: https://github.com/janhq/cortex.git Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers
👋 JanUpdated -
OpenLIT is an open-source LLM Observability tool built on OpenTelemetry.
📈 🔥 Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions along with complete APM for LLM Apps.🖥 ️Updated -
https://github.com/Lightning-AI/litgpt 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
🔗 https://lightning.ai/Updated -
https://github.com/AI-Engineer-Foundation/agent-protocol Common interface for interacting with AI agents. The protocol is tech stack agnostic - you can use it with any framework for building agents.
Updated -
https://github.com/InternLM/OpenAOE LLM Group Chat Framework: chat with multiple LLMs at the same time. 大模型群聊框架:同时与多个大语言模型聊天。
Updated