llm

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure. burr.dagworks.io

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.

https://github.com/run-llama/LlamaIndexTS LlamaIndex is a data framework for your LLM applications

https://github.com/joaomdmoura/crewAI Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

crewai.com

https://github.com/lmstudio-ai/lms LMStudio in your terminal https://lms.dev/

https://github.com/run-llama/llama_index LlamaIndex is a data framework for your LLM applications

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API. https://github.com/Portkey-AI/gateway

https://github.com/janhq/cortex Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

https://github.com/janhq/cortex.tensorrt-llm Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU accelerated inference on NVIDIA's GPUs.

The Arcee client for executing domain-adpated language model routines

https://github.com/mistralai/mistral-inference Official inference library for Mistral models

mistral.ai/

Tools for merging pretrained large language models.

https://github.com/brokensandals/maubot-llm This is a very basic maubot plugin for invoking LLMs.

https://github.com/lm-sys/FastChat An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Resources

https://github.com/fabriziosalmi/UglyFeed Retrieve, aggregate, filter, evaluate, rewrite and serve RSS feeds using Large Language Models for fun, research and learning purposes.

Routes to the most performant and cost efficient LLM based on your prompt [ 🚧 WIP ]

Domain Adapted Language Modeling Toolkit - E2E RAG

https://github.com/Upsonic/Tiger Neuralink for your AI Agents - LangChain - Autogen - CrewAI

Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models" https://arxiv.org/pdf/2308.09687.pdf https://github.com/spcl/graph-of-thoughts

https://github.com/dot-agent/nextpy 🤖Self-Modifying Framework from the Future 🔮 World's First AMS