pytorch

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

huggingface.co/transformers https://github.com/huggingface/transformers

🔧🔗github hf diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

🕸️🔗huggingface.co/docs/diffusers

https://github.com/Lightning-AI/torchmetrics Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications. 🔗 https://lightning.ai/docs/torchmetrics/

LLMs from scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step 🔧🔗https://github.com/rasbt/LLMs-from-scratch

ESPNet

🔧🔗https://github.com/espnet/espnet End-to-End Speech Processing Toolkit

🔧🔗https://github.com/modelscope/data-juicer Making data higher-quality, juicier, and more digestible for foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

https://github.com/Lightning-AI/lightning-thunder Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

🔧🔗https://github.com/yandexdataschool/Practical_RL A course in reinforcement learning in the wild

🔧🔗https://github.com/lucidrains/alphafold3-pytorch Implementation of Alphafold 3 from Google Deepmind in Pytorch

🔧🔗https://github.com/markovka17/digit-recognition A small model for recognition of digits in audio clips

https://github.com/fishaudio/fish-diffusion

An easy to understand TTS / SVS / SVC framework

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6