-
- Downloads
Merge branch 'main' of github.com:THUDM/SwissArmyTransformer into main
No related branches found
No related tags found
Showing
- data_utils/__init__.py 2 additions, 4 deletionsdata_utils/__init__.py
- data_utils/configure_data.py 23 additions, 47 deletionsdata_utils/configure_data.py
- data_utils/datasets.py 1 addition, 78 deletionsdata_utils/datasets.py
- data_utils/samplers.py 9 additions, 9 deletionsdata_utils/samplers.py
- data_utils/sp_tokenizer.py 0 additions, 150 deletionsdata_utils/sp_tokenizer.py
- data_utils/templates.py 0 additions, 83 deletionsdata_utils/templates.py
- data_utils/unified_tokenizer.py 0 additions, 212 deletionsdata_utils/unified_tokenizer.py
- data_utils/vqvae_tokenizer.py 0 additions, 86 deletionsdata_utils/vqvae_tokenizer.py
- mpu/initialize.py 1 addition, 1 deletionmpu/initialize.py
- pretrain_gpt2.py 26 additions, 1 deletionpretrain_gpt2.py
- training/deepspeed_training.py 9 additions, 8 deletionstraining/deepspeed_training.py
Loading
Please register or sign in to comment
