Large Language Models

🔧🔗https://github.com/Aider-AI/aider

aider is AI pair programming in your terminal

🔧🔗 meta-llama/llama-recipes Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs.

https://github.com/ComposioHQ/composio Composio equip's your AI agents & LLMs with 100+ high-quality integrations via function calling

https://github.com/janhq/nitro.git now: https://github.com/janhq/cortex.git Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

🔧🔗https://github.com/Cinnamon/kotaemon

An open-source RAG-based tool for chatting with your documents. 🕸️🔗https://cinnamon.github.io/kotaemon/

🔧🔗https://github.com/yohasebe/code-packager 📦 A set of bash scripts that package and unpack your codebase into and from a single JSON file, ready to be analyzed and understood by large language models

OpenLIT is an open-source LLM Observability tool built on OpenTelemetry. 📈🔥 Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions along with complete APM for LLM Apps. 🖥️

https://github.com/THUDM/CogVideo text and image to video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

https://github.com/fishaudio/Bert-VITS2 vits2 backbone with multilingual-bert

https://github.com/lm-sys/FastChat An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Resources

🔧🔗https://github.com/getzep/zep

Zep | The Memory Foundation For Your AI Stack

https://github.com/Lightning-AI/litgpt 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale. 🔗 https://lightning.ai/

https://github.com/mlc-ai/web-llm High-performance In-browser LLM Inference Engine

https://github.com/princeton-nlp/SWE-agent SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It solves 12.47% of bugs in the SWE-bench evaluation set and takes just 1 minute to run.

https://github.com/THUDM/LongBench [ACL 2024] LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding

https://github.com/mlc-ai/mlc-llm Universal LLM Deployment Engine with ML Compilation

https://github.com/janhq/cortex Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

🔧🔗https://github.com/llmware-ai/llmware

Unified framework for building enterprise RAG pipelines with small, specialized models

[🕸🔗https://llmware-ai.github.io/llmware/](https://llmware-ai.github.io/llmwa

https://github.com/mistralai/mistral-inference Official inference library for Mistral models

mistral.ai/

https://github.com/topoteretes/PromethAI-Backend Open-source framework that gives you AI Agents that help you navigate decision-making, get personalized goals and execute them

www.prometh.ai