pytorch

https://github.com/Lightning-AI/lightning-thunder Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

huggingface.co/transformers https://github.com/huggingface/transformers

https://github.com/Lightning-AI/pytorch-lightning 🔗 lightning.ai Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

🔧🔗 meta-llama/llama-recipes Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs.

https://github.com/Lightning-AI/lightning-Habana Lightning support for Intel Habana accelerators.

🔧🔗https://github.com/NVIDIA/apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

https://github.com/THUDM/SwissArmyTransformer SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

https://github.com/THUDM/CogView2 official code repo for paper "CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers"

https://github.com/fishaudio/fish-diffusion

An easy to understand TTS / SVS / SVC framework

https://github.com/coqui-ai/TTS 🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production