Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

Llama Recipes
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Iterations
- Wiki
- Environments
- Terraform modules
- Incidents
- Service Desk

Snippets Groups Projects

e5970e2e

Unverified Commit e5970e2e authored 1 year ago by Geeta Chauhan Committed by GitHub 1 year ago

Downloads
- Plain Diff

Improve FSDP LoRA Memory Usage (#41)

parents 1e0f8a1f 71fdc492

No related branches found

No related tags found

Loading

Changes 4

Hide whitespace changes

Inline Side-by-side

Showing

llama_finetuning.py 1 addition, 1 deletion

llama_finetuning.py
model_checkpointing/checkpoint_handler.py 1 addition, 1 deletion

model_checkpointing/checkpoint_handler.py
policies/activation_checkpointing_functions.py 1 addition, 1 deletion

policies/activation_checkpointing_functions.py
utils/train_utils.py 2 additions, 3 deletions

utils/train_utils.py

with 5 additions and 6 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment

Strive to be the person your dogs believe you are