transformers

https://github.com/lucidrains/x-transformers A simple but complete full-attention transformer with a set of promising experimental features from various papers

https://github.com/InternLM/lagent A lightweight framework for building LLM-based agents

https://github.com/lucidrains/vit-pytorch mplementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

https://github.com/lucidrains/audiolm-pytorch Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch

https://github.com/lucidrains/soundstorm-pytorch Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

🔧🔗https://github.com/FoundationVision/VAR [NeurIPS 2024 Oral][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An ultra-simple, user-friendly yet state-of-the-art codebase for autoregressive image generation!

https://github.com/lucidrains/magvit2-pytorch Implementation of MagViT2 Tokenizer in Pytorch

🔧🔗https://github.com/forhaoliu/ringattention

Transformers with Arbitrarily Large Context

https://github.com/lucidrains/meshgpt-pytorch

Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch

🔧🔗https://github.com/HumanSignal/label-studio-transformers

Label data using HuggingFace's transformers and automatically get a prediction service

https://github.com/lucidrains/self-rewarding-lm-pytorch Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI

https://github.com/lucidrains/self-reasoning-tokens-pytorch Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto

https://github.com/lucidrains/musiclm-pytorch Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch