G

gpt

🔧🔗https://github.com/vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

🔧🔗https://github.com/langfuse/langfuse 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, L

🔧🔗https://github.com/All-Hands-AI/OpenHands

🙌 OpenHands: Code Less, Make More

🔧🔗https://github.com/HKUDS/LightRAG

"LightRAG: Simple and Fast Retrieval-Augmented Generation"

https://github.com/janhq/jan Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM) 🔗 https://jan.ai

https://github.com/Upsonic/gpt-computer-assistant Intelligence development framework in python for your product like Apple Intelligence

🔧🔗https://github.com/modelscope/data-juicer Making data higher-quality, juicier, and more digestible for foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

🔧🔗https://github.com/tensorzero/tensorzero TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation

https://github.com/openlit/helm Helm Charts to deploy and manage OpenLIT in Kubernetes

🔧🔗https://github.com/hiyouga/LLaMA-Factory Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

🔧🔗https://github.com/dzhng/deep-research An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine its research direction overtime and deep dive into a topic.

LLMs from scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step 🔧🔗https://github.com/rasbt/LLMs-from-scratch

🔧🔗https://github.com/poloclub/transformer-explainer

Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization

https://github.com/InternLM/lagent A lightweight framework for building LLM-based agents

🔧🔗https://github.com/Haidra-Org/AI-Horde

A crowdsourced distributed cluster for AI art and text generation

Easy Edit

🔧🔗https://github.com/zjunlp/EasyEdit [ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

🔧🔗https://github.com/modelscope/modelscope-agent

ModelScope-Agent: An agent framework connecting models in ModelScope with the world

🔧🔗https://github.com/Skyvern-AI/skyvern

Automate browser-based workflows with LLMs and Computer Vision 🕸️🔗 www.skyvern.com/

🔧🔗https://github.com/metauto-ai/GPTSwarm

🐝 GPTSwarm: LLM agents as (Optimizable) Graphs

🕸️🔗https://gptswarm.org

🔧🔗https://github.com/geekan/MetaGPT 🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming