pytorch

🔧🔗https://github.com/NVIDIA/apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

huggingface.co/transformers https://github.com/huggingface/transformers

https://github.com/roboflow/supervision We write your reusable computer vision tools. 💜

https://github.com/Lightning-AI/torchmetrics Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications. 🔗 https://lightning.ai/docs/torchmetrics/

https://github.com/Lightning-AI/pytorch-lightning 🔗 lightning.ai Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

https://github.com/Lightning-AI/lightning-thunder Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

🔧🔗 meta-llama/llama-recipes Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs.

https://github.com/Lightning-AI/lightning-Habana Lightning support for Intel Habana accelerators.

https://github.com/roboflow/notebooks Examples and tutorials on using SOTA computer vision models and techniques. Learn everything from old-school ResNet, through YOLO and object-detection transformers like DETR, to the latest models like Grounding D

https://github.com/THUDM/SwissArmyTransformer SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

https://github.com/THUDM/CogView2 official code repo for paper "CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers"

https://github.com/fishaudio/fish-diffusion

An easy to understand TTS / SVS / SVC framework

https://github.com/homebrewltd/WhisperSpeech An Open Source text-to-speech system built by inverting Whisper. 🔗 https://collabora.github.io/WhisperSpeech/

https://github.com/lucidrains/pytorch-custom-utils Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new AI research

https://github.com/coqui-ai/TTS 🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

https://github.com/coqui-ai/Trainer 🐸 - A general purpose model trainer, as flexible as it gets

https://github.com/lucidrains/genetic-algorithm-pytorch Toy genetic algorithm in Pytorch

https://github.com/neonbjb/ocotillo Performant and accurate speech recognition built on Pytorch

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6