L

Large Language Models

🔧🔗https://github.com/gpustack/gpustack

Manage GPU clusters for running LLMs

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

huggingface.co/transformers https://github.com/huggingface/transformers

🔧🔗https://github.com/getzep/graphiti

Build and query dynamic, temporally-aware Knowledge Graphs

🔧🔗https://github.com/modelscope/data-juicer Making data higher-quality, juicier, and more digestible for foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

SGPT

🔧🔗https://github.com/tbckr/sgpt

SGPT is a command-line tool that provides a convenient way to interact with OpenAI models, enabling users to run queries, generate shell commands and produce code directly from the terminal.

🔧🔗https://github.com/containers/ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all

🔧🔗https://github.com/ihor-sokoliuk/mcp-searxng

This SearXNG MCP Server integrates the SearXNG API, providing web search capabilities.

Topics

Catwalk

🔧🔗https://github.com/charmbracelet/catwalk

🐈 A collection of LLM inference providers and models

https://github.com/Lightning-AI/litgpt 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale. 🔗 https://lightning.ai/

🔧🔗https://github.com/tensorzero/llmgym LLM Gym is a unified environment interface for developing and benchmarking LLM applications that learn from feedback. Think gym for LLM agents.

As the space of benchmar

🔧🔗https://github.com/redis/mcp-redis/ The official Redis MCP Server is a natural language interface designed for agentic applications to manage and search data in Redis efficiently

Easy Edit

🔧🔗https://github.com/zjunlp/EasyEdit [ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

🔧🔗https://github.com/iv-org/matrix-ai-moderator Matrix bot moderator that uses AI to ban new users sending inappropriate messages

🔧🔗https://github.com/microsoft/intelligence-toolkit

Interactive workflows for creating AI intelligence reports from real-world data sources

LLMs from scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step 🔧🔗https://github.com/rasbt/LLMs-from-scratch

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API. https://github.com/Portkey-AI/gateway

🔧🔗https://github.com/llmware-ai/llmware

Unified framework for building enterprise RAG pipelines with small, specialized models

🕸️🔗https://llmware-ai.github.io/llmware/

🔧🔗https://github.com/etkecc/baibot 🤖 A Matrix bot for using diffent capabilities (text-generation, text-to-speech, speech-to-text, image-generation, etc.) of AI / Large Language Models (OpenAI, Anthropic, etc.)

🔧🔗https://github.com/google/ml-metrics Ml-metrics provides performant and distributed friendly ML metrics implementations.

https://github.com/lm-sys/FastChat An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Resources