Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

SwissArmyTransformer
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Iterations
- Wiki
- Environments
- Terraform modules
- Incidents
- Service Desk

Snippets Groups Projects

87d6ae9c

Commit 87d6ae9c authored 3 years ago by Ming Ding

Downloads
- Patches
- Plain Diff

tmp save

parent 6b89c2bd

No related branches found

Tags llamaindex@0.2.9

Loading

Changes 20

Hide whitespace changes

Inline Side-by-side

Showing

draw_diff.py 16 additions, 7 deletions

draw_diff.py
finetune/__init__.py 0 additions, 0 deletions

finetune/__init__.py
fp16/__init__.py 0 additions, 30 deletions

fp16/__init__.py
fp16/fp16.py 0 additions, 629 deletions

fp16/fp16.py
fp16/fp16util.py 0 additions, 204 deletions

fp16/fp16util.py
fp16/loss_scaler.py 0 additions, 237 deletions

fp16/loss_scaler.py
generate_samples.py 0 additions, 2 deletions

generate_samples.py
model/__init__.py 0 additions, 1 deletion

model/__init__.py
model/base_model.py 54 additions, 0 deletions

model/base_model.py
model/distributed.py 0 additions, 121 deletions

model/distributed.py
model/gpt2.py 17 additions, 0 deletions

model/gpt2.py
model/gpt2_modeling.py 0 additions, 126 deletions

model/gpt2_modeling.py
model/mixins.py 69 additions, 0 deletions

model/mixins.py
mpu/__init__.py 2 additions, 4 deletions

mpu/__init__.py
mpu/grads.py 0 additions, 74 deletions

mpu/grads.py
mpu/sparse_transformer.py 0 additions, 729 deletions

mpu/sparse_transformer.py
mpu/transformer.py 412 additions, 0 deletions

mpu/transformer.py
mpu/utils.py 25 additions, 11 deletions

mpu/utils.py
pretrain_gpt2.py 63 additions, 93 deletions

pretrain_gpt2.py
utils.py 0 additions, 22 deletions

utils.py

with 658 additions and 2290 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment

Strive to be the person your dogs believe you are