Mixture Of Depths

Project information

🔧🔗https://github.com/astramind-ai/Mixture-of-depths Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"

mixture-of-d... Python

28 Commits
1 Branch
0 Tags

README

Created on

December 09, 2024

Loading

🐾❤️ Strive to be the person your dogs believe you are ❤️🐾