transformers

https://github.com/lucidrains/soundstorm-pytorch Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

https://github.com/lucidrains/x-transformers A simple but complete full-attention transformer with a set of promising experimental features from various papers

https://github.com/huggingface/swift-transformers Swift Package to implement a transformers-like API in Swift

https://github.com/lucidrains/vit-pytorch mplementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

https://github.com/InternLM/lagent A lightweight framework for building LLM-based agents

https://github.com/lucidrains/meshgpt-pytorch

Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch

https://github.com/lucidrains/magvit2-pytorch Implementation of MagViT2 Tokenizer in Pytorch

https://github.com/lucidrains/self-rewarding-lm-pytorch Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI

https://github.com/lucidrains/self-reasoning-tokens-pytorch Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto

https://github.com/lucidrains/musiclm-pytorch Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch

https://github.com/lucidrains/audiolm-pytorch Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch