pytorch

🔧🔗https://github.com/sgl-project/sglang

SGLang is a fast serving framework for large language models and vision language models.

🔧🔗https://github.com/vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

huggingface.co/transformers https://github.com/huggingface/transformers

🔧🔗https://github.com/flashinfer-ai/flashinfer

FlashInfer: Kernel Library for LLM Serving

🕸️🔗flashinfer.ai

🔧🔗https://github.com/pytorch/torchtune PyTorch native post-training library

🕸️🔗pytorch.org/torchtune/main/

🔧🔗https://github.com/huggingface/lerobot

🤗 LeRobot: Making AI for Robotics more accessible with end-to-end learning

🔧🔗https://github.com/speechbrain/speechbrain A PyTorch-based Speech Toolkit

https://github.com/Lightning-AI/pytorch-lightning 🔗 lightning.ai Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

https://github.com/Lightning-AI/lightning-thunder Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

🔧🔗github hf diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

🕸️🔗huggingface.co/docs/diffusers

🔧🔗https://github.com/modelscope/data-juicer Making data higher-quality, juicier, and more digestible for foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

🔧🔗https://github.com/modelscope/FunASR A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing

🔧🔗https://github.com/IAHispano/Applio

A simple, high-quality voice conversion tool focused on ease of use and performance

https://github.com/roboflow/supervision We write your reusable computer vision tools. 💜

🔧🔗https://github.com/NVIDIA/apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

🔧🔗https://github.com/blaisewf/rvc-cli 🚀 RVC + UVR = A perfect set of tools for voice cloning, easily and free!

🔧🔗https://github.com/lucidrains/transfusion-pytorch

Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI

https://github.com/Lightning-AI/torchmetrics Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications. 🔗 https://lightning.ai/docs/torchmetrics/

🔧🔗https://github.com/lucidrains/vector-quantize-pytorch Vector (and Scalar) Quantization, in Pytorch

🔧🔗https://github.com/pytorch/serve

Serve, optimize and scale PyTorch models in production