L

Large Language Models

https://github.com/agentclientprotocol/python-sdk

Python SDK for ACP clients and agents.

https://github.com/Blaizzy/mlx-vlm MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

https://github.com/mlc-ai/web-llm High-performance In-browser LLM Inference Engine

🔧🔗https://github.com/asgeirtj/system_prompts_leaks Collection of extracted System Prompts from popular chatbots like ChatGPT, Claude & Gemini

https://github.com/lmstudio-ai/lms LMStudio in your terminal https://lms.dev/

🔧🔗https://github.com/google/ml-metrics Ml-metrics provides performant and distributed friendly ML metrics implementations.

🔧🔗https://github.com/zjunlp/EasyEdit [ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

🔧🔗https://github.com/jingyaogong/minimind 🚀🚀 「大模型」2小时完全从0训练26M的小参数GPT！🌏 Train a 26M-parameter GPT from scratch in just 2h!

🔧🔗https://github.com/patchy631/ai-engineering-hub In-depth tutorials on LLMs, RAGs and real-world AI agent applications.

🔧🔗https://github.com/modelscope/evalscope A streamlined and customizable framework for efficient large model evaluation and performance benchmarking

🔧🔗https://github.com/QwenLM/Qwen The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

https://github.com/mlc-ai/mlc-llm Universal LLM Deployment Engine with ML Compilation

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step 🔧🔗https://github.com/rasbt/LLMs-from-scratch

🔧🔗https://github.com/HKUDS/LightRAG

"LightRAG: Simple and Fast Retrieval-Augmented Generation"

https://github.com/run-llama/LlamaIndexTS LlamaIndex is a data framework for your LLM applications

🔧🔗https://github.com/tbckr/sgpt

SGPT is a command-line tool that provides a convenient way to interact with OpenAI models, enabling users to run queries, generate shell commands and produce code directly from the terminal.

https://github.com/hybridgroup/yzma Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration.

OpenLIT is an open-source LLM Observability tool built on OpenTelemetry. 📈🔥 Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions along with complete APM for LLM Apps. 🖥️

🔧🔗https://github.com/google/langfun

OO for LLMs

🔧🔗https://github.com/maragudk/gai Go Artificial Intelligence (GAI) helps you work with foundational models, large language models, and other AI models.