Projects with this topic
Sort by:
-
🔧 🔗 https://github.com/QwenLM/online_merging_optimizers Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in AlignmentUpdated -
🔧 🔗 https://github.com/lucidrains/lion-pytorch🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in PytorchUpdated
