Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

SwissArmyTransformer
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Iterations
- Wiki
- Environments
- Terraform modules
- Incidents
- Service Desk

Snippets Groups Projects

913ce150

Commit 913ce150 authored 3 years ago by duzx16

Downloads
- Patches
- Plain Diff

Update implementation for T5

parent fdcf4735

No related branches found

No related tags found

No related merge requests found

Changes 7

Hide whitespace changes

Inline Side-by-side

Showing

SwissArmyTransformer/model/t5_model.py 46 additions, 8 deletions

SwissArmyTransformer/model/t5_model.py
SwissArmyTransformer/mpu/layers.py 7 additions, 7 deletions

SwissArmyTransformer/mpu/layers.py
SwissArmyTransformer/mpu/transformer.py 77 additions, 62 deletions

SwissArmyTransformer/mpu/transformer.py
SwissArmyTransformer/mpu/utils.py 2 additions, 2 deletions

SwissArmyTransformer/mpu/utils.py
SwissArmyTransformer/tokenization/__init__.py 1 addition, 1 deletion

SwissArmyTransformer/tokenization/__init__.py
SwissArmyTransformer/tokenization/hf_tokenizer.py 15 additions, 0 deletions

SwissArmyTransformer/tokenization/hf_tokenizer.py
SwissArmyTransformer/training/deepspeed_training.py 4 additions, 1 deletion

SwissArmyTransformer/training/deepspeed_training.py

with 152 additions and 81 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment

Strive to be the person your dogs believe you are