Python

🔧🔗https://github.com/tensorzero/tensorzero TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation

🔧🔗https://github.com/microsoft/intelligence-toolkit

Interactive workflows for creating AI intelligence reports from real-world data sources

https://github.com/roboflow/inference A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.

OpenLIT is an open-source LLM Observability tool built on OpenTelemetry. 📈🔥 Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions along with complete APM for LLM Apps. 🖥️

🔧🔗https://github.com/Skyvern-AI/skyvern

Automate browser-based workflows with LLMs and Computer Vision 🕸️🔗 www.skyvern.com/

Sentry

🔧🔗https://github.com/getsentry/sentry

Developer-first error tracking and performance monitoring

Spectrum

https://github.com/QuixiAI/spectrum This repository contains the implementation of Spectrum, as detailed in the paper Spectrum: Targeted Training on Signal to Noise Ratio.

https://github.com/Lightning-AI/torchmetrics Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications. 🔗 https://lightning.ai/docs/torchmetrics/

🔧🔗https://github.com/google/langfun

OO for LLMs

A feature-rich command-line audio/video downloader

LLMs from scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step 🔧🔗https://github.com/rasbt/LLMs-from-scratch

MLX-lm

🔧🔗https://github.com/ml-explore/mlx-lm Run LLMs with MLX

Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.

docs.danswer.dev/

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

huggingface.co/transformers https://github.com/huggingface/transformers

Apprise

🔧🔗https://github.com/caronc/apprise Apprise - Push Notifications that work with just about every platform!

🔧🔗https://github.com/speechbrain/speechbrain A PyTorch-based Speech Toolkit

🔧🔗https://github.com/mem0ai/mem0 Memory for AI Agents; SOTA in AI Agent Memory; Announcing OpenMemory MCP - local and secure memory management.

🔧🔗https://github.com/modelscope/modelscope-agent

ModelScope-Agent: An agent framework connecting models in ModelScope with the world

🔧🔗https://github.com/pytorch/torchtune PyTorch native post-training library

🕸️🔗pytorch.org/torchtune/main/

https://github.com/Upsonic/Upsonic Self-Driven Autonomous Python Libraries