pytorch

https://github.com/THUDM/SwissArmyTransformer SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

🔧🔗https://github.com/lucidrains/grokfast-pytorch

Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"

🔧🔗https://github.com/modelscope/AdaSeq

An All-in-One Library for Developing State-of-the-Art Sequence Understanding Models

🔧🔗https://github.com/lucidrains/lion-pytorch

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

🔧🔗https://github.com/markovka17/digit-recognition A small model for recognition of digits in audio clips

🔧🔗https://github.com/markovka17/vqvae VQVAE | VAE | GumbelVAE | PixelCNN

https://github.com/THUDM/CogView2 official code repo for paper "CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers"

https://github.com/fishaudio/fish-diffusion

An easy to understand TTS / SVS / SVC framework

https://github.com/lucidrains/pytorch-custom-utils Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new AI research

https://github.com/coqui-ai/TTS 🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

https://github.com/coqui-ai/Trainer 🐸 - A general purpose model trainer, as flexible as it gets

https://github.com/neonbjb/ocotillo Performant and accurate speech recognition built on Pytorch

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6