Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

SwissArmyTransformer
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Iterations
- Wiki
- Environments
- Terraform modules
- Incidents
- Service Desk

Snippets Groups Projects

5db7dfe4

Commit 5db7dfe4 authored 3 years ago by Ming Ding

Downloads
- Patches
- Plain Diff

tmp save3

parent 18be5e6a

No related branches found

No related tags found

No related merge requests found

Changes 10

Expand all Hide whitespace changes

Inline Side-by-side

Showing

model/base_model.py 2 additions, 1 deletion

model/base_model.py
model/cached_autoregressive_model.py 2 additions, 2 deletions

model/cached_autoregressive_model.py
model/cuda2d_model.py 153 additions, 0 deletions

model/cuda2d_model.py
model/mixins.py 2 additions, 2 deletions

model/mixins.py
mpu/local_attention_function.py 0 additions, 79 deletions

mpu/local_attention_function.py
mpu/transformer.py 3 additions, 30 deletions

mpu/transformer.py
pretrain_gpt2.py 27 additions, 748 deletions

pretrain_gpt2.py
training/deepspeed_training.py 583 additions, 0 deletions

training/deepspeed_training.py
training/learning_rates.py 81 additions, 0 deletions

training/learning_rates.py
training/model_io.py 162 additions, 0 deletions

training/model_io.py

with 1015 additions and 862 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment

Strive to be the person your dogs believe you are