lightning

https://github.com/Lightning-AI/lightning-thunder Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.