L

Large Language Models

🔧🔗https://github.com/tbckr/sgpt

SGPT is a command-line tool that provides a convenient way to interact with OpenAI models, enabling users to run queries, generate shell commands and produce code directly from the terminal.

https://github.com/agentclientprotocol/rust-sdk

Rust SDK for ACP clients and agents.

OpenLIT is an open-source LLM Observability tool built on OpenTelemetry. 📈🔥 Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions along with complete APM for LLM Apps. 🖥️

https://github.com/openlit/helm Helm Charts to deploy and manage OpenLIT in Kubernetes

https://github.com/mlc-ai/web-llm High-performance In-browser LLM Inference Engine

🔧🔗https://github.com/iv-org/matrix-ai-moderator Matrix bot moderator that uses AI to ban new users sending inappropriate messages

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step 🔧🔗https://github.com/rasbt/LLMs-from-scratch

🔧🔗https://github.com/microsoft/intelligence-toolkit

Interactive workflows for creating AI intelligence reports from real-world data sources

🔧🔗https://github.com/cohere-ai/cohere-terrarium

A simple Python sandbox for helpful LLM data agents

https://github.com/mlc-ai/mlc-llm Universal LLM Deployment Engine with ML Compilation

https://github.com/Lightning-AI/litgpt 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale. 🔗 https://lightning.ai/

🔧🔗https://github.com/redis/mcp-redis/ The official Redis MCP Server is a natural language interface designed for agentic applications to manage and search data in Redis efficiently

🔧🔗https://github.com/jingyaogong/minimind 🚀🚀 「大模型」2小时完全从0训练26M的小参数GPT！🌏 Train a 26M-parameter GPT from scratch in just 2h!

🔧🔗https://github.com/poloclub/transformer-explainer

Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization

🔧🔗https://github.com/Aider-AI/aider

aider is AI pair programming in your terminal

🔧🔗https://github.com/getzep/zep

Zep | The Memory Foundation For Your AI Stack

🔧🔗https://github.com/getzep/zep-python

Zep: Long-Term Memory for ‍AI Assistants (Python Client)

🔧🔗https://github.com/EleutherAI/lm-evaluation-harness A framework for few-shot evaluation of language models.

🔧🔗https://github.com/ml-explore/mlx-lm Run LLMs with MLX

🔧🔗https://github.com/google/ml-metrics Ml-metrics provides performant and distributed friendly ML metrics implementations.