Skip to content
Snippets Groups Projects
Unverified Commit f521c93d authored by Patrik Lambert's avatar Patrik Lambert Committed by GitHub
Browse files

Fix numpy seed in finetuning.py

Set numpy seed in finetuning.py to fix it during finetuning (including in custom_dataset.py) and have it set in functions such as Dataset.train_test_split. This avoids having different train/test splits in different ranks, which may cause NCCL collective operation timeout errors.
parent d6ae2031
No related branches found
No related tags found
No related merge requests found
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment