Large Language Models

https://github.com/InternLM/lmdeploy LMDeploy is a toolkit for compressing, deploying, and serving LLMs. 🔗 lmdeploy.readthedocs.io/en/latest/

🔧🔗https://github.com/Skyvern-AI/skyvern

Automate browser-based workflows with LLMs and Computer Vision 🕸️🔗 www.skyvern.com/

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure. burr.dagworks.io

https://github.com/ComposioHQ/composio Composio equip's your AI agents & LLMs with 100+ high-quality integrations via function calling

https://github.com/janhq/nitro.git now: https://github.com/janhq/cortex.git Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

🔧🔗https://github.com/BerriAI/litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq] 🕸️🔗docs.litellm.ai/docs/

https://github.com/run-llama/LlamaIndexTS LlamaIndex is a data framework for your LLM applications

🔧🔗https://github.com/Cinnamon/kotaemon

An open-source RAG-based tool for chatting with your documents. 🕸️🔗https://cinnamon.github.io/kotaemon/

🔧🔗https://github.com/yohasebe/code-packager 📦 A set of bash scripts that package and unpack your codebase into and from a single JSON file, ready to be analyzed and understood by large language models

🔧🔗https://github.com/Aider-AI/aider

aider is AI pair programming in your terminal

https://github.com/run-llama/llama_index LlamaIndex is a data framework for your LLM applications

https://github.com/joaomdmoura/crewAI Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

crewai.com

https://github.com/lmstudio-ai/lms LMStudio in your terminal https://lms.dev/

Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models" https://arxiv.org/pdf/2308.09687.pdf https://github.com/spcl/graph-of-thoughts

🔧🔗https://github.com/getzep/graphiti

Build and query dynamic, temporally-aware Knowledge Graphs

🔧🔗 meta-llama/llama-recipes Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs.

OpenLIT is an open-source LLM Observability tool built on OpenTelemetry. 📈🔥 Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions along with complete APM for LLM Apps. 🖥️

🔧🔗https://github.com/aurelio-labs/semantic-router

Superfast AI decision making and intelligent processing of multi-modal data.

https://github.com/InternLM/lagent A lightweight framework for building LLM-based agents

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.