-
- Downloads
save cpu mem by leveraging FSDP rank0 broadcasting (#77)
No related branches found
No related tags found
Showing
- README.md 10 additions, 0 deletionsREADME.md
- configs/training.py 2 additions, 1 deletionconfigs/training.py
- docs/multi_gpu.md 10 additions, 0 deletionsdocs/multi_gpu.md
- llama_finetuning.py 72 additions, 65 deletionsllama_finetuning.py
- model_checkpointing/checkpoint_handler.py 2 additions, 2 deletionsmodel_checkpointing/checkpoint_handler.py
- utils/train_utils.py 1 addition, 1 deletionutils/train_utils.py
Loading
Please register or sign in to comment
