Commits · 981fdabd8c29ec008d44c84f2b05aef970d674f1 · mirrored_repos / MachineLearning / thukeg / SwissArmyTransformer

This project is mirrored from https://github.com/THUDM/SwissArmyTransformer. Pull mirroring failed 2 months ago.
Repository mirroring has been paused due to too many failed attempts. It can be resumed by a project maintainer or owner.
Last successful update 2 months ago.

Dec 13, 2021
- Merge branch 'glm_finetune' into finer-attn-hooks · 981fdabd
  Ming Ding authored 3 years ago
  
  981fdabd
- Merge branch 'finer-attn-hooks' of github.com:THUDM/SwissArmyTransformer into finer-attn-hooks · 56936ad9
  Ming Ding authored 3 years ago
  
  56936ad9
- fix basemodel typo and old hooks name · bcbc6120
  Ming Ding authored 3 years ago
  
  bcbc6120
- Fix typo in collect_hooks_ · ac77e3bf
  duzx16 authored 3 years ago
  
  ac77e3bf
- Add non_conflict for T5 attention · 51e1a513
  duzx16 authored 3 years ago
  
  fix position bias for memory in T5
  51e1a513
- Delete unused code · c17f8035
  duzx16 authored 3 years ago
  
  c17f8035
- Implement T5 Attention with attention_fn · 4e0e9674
  duzx16 authored 3 years ago
  
  4e0e9674
Dec 12, 2021
- Add no share embeddings for T5 · 91afa917
  duzx16 authored 3 years ago
  
  91afa917
- Fix return values for SelfAttention · 407a44a5
  duzx16 authored 3 years ago
  
  407a44a5
- Merge branch 'enc-dec' into finer-attn-hooks · 0d2385f3
  duzx16 authored 3 years ago
  
  # Conflicts: # SwissArmyTransformer/generation/autoregressive_sampling.py # SwissArmyTransformer/model/cached_autoregressive_model.py # SwissArmyTransformer/model/t5_model.py # examples/t5/test_t5.py
  0d2385f3
- Add support for T5 v1.1 · 308e87b0
  duzx16 authored 3 years ago
  
  308e87b0
- Use assert to ensure cross_attention_mask · 7c573bbd
  duzx16 authored 3 years ago
  
  Add default value (None) for dec_attention_mask in T5 forward
  7c573bbd
- Better test script for transformers t5 · 57d82dff
  duzx16 authored 3 years ago
  
  57d82dff
- add prefix-tuning & glm sst2 example · fa77bfc2
  Ming Ding authored 3 years ago
  
  fa77bfc2
Dec 11, 2021
- verify t5 inference and no backward crush · be5e6c90
  Ming Ding authored 3 years ago
  
  be5e6c90
Dec 10, 2021
- Merge remote-tracking branch 'origin/enc-dec' into finer-attn-hooks · dbae1d47
  Ming Ding authored 3 years ago
  
  dbae1d47
- Update implementation for T5 · 913ce150
  duzx16 authored 3 years ago
  
  913ce150
- Update script for backward test · fdcf4735
  duzx16 authored 3 years ago
  
  fdcf4735
- Update script for backward test · adf4133f
  duzx16 authored 3 years ago
  
  adf4133f
Dec 09, 2021
- finish package part, need modify t5 · 4b45416a
  Ming Ding authored 3 years ago
  
  4b45416a
Dec 05, 2021
- remove layer_forward enc-dec params for simple · bd2d86f9
  Ming Ding authored 3 years ago
  
  bd2d86f9
- Add T5 Tokenizer · 049b6ffc
  duzx16 authored 3 years ago
  
  049b6ffc
- Add default attention mask for EncoderDecoder · 3fc1af82
  duzx16 authored 3 years ago
  
  Remove position id arguments for T5
  3fc1af82
- Fix bug in Transformer implementation · 63c5ce73
  duzx16 authored 3 years ago
  
  63c5ce73
- tmp_save · 8db7ecd7
  Ming Ding authored 3 years ago
  
  8db7ecd7
- Merge remote-tracking branch 'origin/enc-dec' into enc-dec · 07d5dc0f
  duzx16 authored 3 years ago
  
  07d5dc0f
- Add test scripts for T5 · f8e4c9f0
  duzx16 authored 3 years ago
  
  f8e4c9f0
- tidy up enc-dec model · 6a2fa408
  Ming Ding authored 3 years ago
  
  6a2fa408
Dec 04, 2021
- Merge branch 'tmp_eval_support' into enc-dec · 3ab8731b
  Ming Ding authored 3 years ago
  
  3ab8731b
- add strict-eval support · 44333e0f
  Ming Ding authored 3 years ago
  
  44333e0f
- Add requires_grad at the beginning · 00442c04
  duzx16 authored 3 years ago
  
  00442c04
- Remove common layers · be349db4
  duzx16 authored 3 years ago
  
  be349db4
- Fix scaling_attention_score in standard_attention · 0ac85141
  duzx16 authored 3 years ago
  
  0ac85141
- Fix T5 Model · 9bedc566
  duzx16 authored 3 years ago
  
  9bedc566
Dec 02, 2021
- Implement T5 model · cc852e00
  duzx16 authored 3 years ago
  
  cc852e00
Dec 01, 2021
- Reformat code · 7aee8e24
  duzx16 authored 3 years ago
  
  7aee8e24
- Reformat code · c761af73
  duzx16 authored 3 years ago
  
  c761af73
- Merge branch 'package' of github.com:THUDM/SwissArmyTransformer into package · b32f9dde
  duzx16 authored 3 years ago
  
  Conflicts: SwissArmyTransformer/mpu/transformer.py SwissArmyTransformer/training/deepspeed_training.py
  b32f9dde
- Accept config_params for deepspeed engine · b84c5aa0
  duzx16 authored 3 years ago
  
  b84c5aa0
Nov 30, 2021
- Merge branch 'package' of github.com:THUDM/SwissArmyTransformer into package · 33bbb65c
  Ming Ding authored 3 years ago
  
  33bbb65c