Commits · 91afa917ed43cee124a609b469b4f6c005d1b5c7 · mirrored_repos / MachineLearning / thukeg / SwissArmyTransformer

This project is mirrored from https://github.com/THUDM/SwissArmyTransformer. Pull mirroring failed 2 months ago.
Repository mirroring has been paused due to too many failed attempts. It can be resumed by a project maintainer or owner.
Last successful update 2 months ago.

Dec 12, 2021
- Add no share embeddings for T5 · 91afa917
  duzx16 authored 3 years ago
  
  91afa917
- Fix return values for SelfAttention · 407a44a5
  duzx16 authored 3 years ago
  
  407a44a5
- Merge branch 'enc-dec' into finer-attn-hooks · 0d2385f3
  duzx16 authored 3 years ago
  
  # Conflicts: # SwissArmyTransformer/generation/autoregressive_sampling.py # SwissArmyTransformer/model/cached_autoregressive_model.py # SwissArmyTransformer/model/t5_model.py # examples/t5/test_t5.py
  0d2385f3
- Add support for T5 v1.1 · 308e87b0
  duzx16 authored 3 years ago
  
  308e87b0
- Use assert to ensure cross_attention_mask · 7c573bbd
  duzx16 authored 3 years ago
  
  Add default value (None) for dec_attention_mask in T5 forward
  7c573bbd
- Better test script for transformers t5 · 57d82dff
  duzx16 authored 3 years ago
  
  57d82dff
Dec 11, 2021
- verify t5 inference and no backward crush · be5e6c90
  Ming Ding authored 3 years ago
  
  be5e6c90
Dec 10, 2021
- Merge remote-tracking branch 'origin/enc-dec' into finer-attn-hooks · dbae1d47
  Ming Ding authored 3 years ago
  
  dbae1d47
- Update implementation for T5 · 913ce150
  duzx16 authored 3 years ago
  
  913ce150
- Update script for backward test · fdcf4735
  duzx16 authored 3 years ago
  
  fdcf4735
- Update script for backward test · adf4133f
  duzx16 authored 3 years ago
  
  adf4133f
Dec 09, 2021
- finish package part, need modify t5 · 4b45416a
  Ming Ding authored 3 years ago
  
  4b45416a
Dec 05, 2021
- remove layer_forward enc-dec params for simple · bd2d86f9
  Ming Ding authored 3 years ago
  
  bd2d86f9
- Add T5 Tokenizer · 049b6ffc
  duzx16 authored 3 years ago
  
  049b6ffc
- Add default attention mask for EncoderDecoder · 3fc1af82
  duzx16 authored 3 years ago
  
  Remove position id arguments for T5
  3fc1af82
- Fix bug in Transformer implementation · 63c5ce73
  duzx16 authored 3 years ago
  
  63c5ce73
- tmp_save · 8db7ecd7
  Ming Ding authored 3 years ago
  
  8db7ecd7
- Merge remote-tracking branch 'origin/enc-dec' into enc-dec · 07d5dc0f
  duzx16 authored 3 years ago
  
  07d5dc0f
- Add test scripts for T5 · f8e4c9f0
  duzx16 authored 3 years ago
  
  f8e4c9f0
- tidy up enc-dec model · 6a2fa408
  Ming Ding authored 3 years ago
  
  6a2fa408
Dec 04, 2021
- Merge branch 'tmp_eval_support' into enc-dec · 3ab8731b
  Ming Ding authored 3 years ago
  
  3ab8731b
- add strict-eval support · 44333e0f
  Ming Ding authored 3 years ago
  
  44333e0f
- Add requires_grad at the beginning · 00442c04
  duzx16 authored 3 years ago
  
  00442c04
- Remove common layers · be349db4
  duzx16 authored 3 years ago
  
  be349db4
- Fix scaling_attention_score in standard_attention · 0ac85141
  duzx16 authored 3 years ago
  
  0ac85141
- Fix T5 Model · 9bedc566
  duzx16 authored 3 years ago
  
  9bedc566
Dec 02, 2021
- Implement T5 model · cc852e00
  duzx16 authored 3 years ago
  
  cc852e00
Dec 01, 2021
- Reformat code · 7aee8e24
  duzx16 authored 3 years ago
  
  7aee8e24
- Reformat code · c761af73
  duzx16 authored 3 years ago
  
  c761af73
- Merge branch 'package' of github.com:THUDM/SwissArmyTransformer into package · b32f9dde
  duzx16 authored 3 years ago
  
  Conflicts: SwissArmyTransformer/mpu/transformer.py SwissArmyTransformer/training/deepspeed_training.py
  b32f9dde
- Accept config_params for deepspeed engine · b84c5aa0
  duzx16 authored 3 years ago
  
  b84c5aa0
Nov 30, 2021
- Merge branch 'package' of github.com:THUDM/SwissArmyTransformer into package · 33bbb65c
  Ming Ding authored 3 years ago
  
  33bbb65c
- add tensorboard log of customized logs · 9eca6ab3
  Ming Ding authored 3 years ago
  
  9eca6ab3
Nov 26, 2021
- Update README.md · cbe869e4
  ledw-2 authored 3 years ago
  
  Add more detailed example in section Run GLM
  Unverified
  
  cbe869e4
Nov 25, 2021
- fix typo encdec · 98a5247a
  Ming Ding authored 3 years ago
  
  98a5247a
- fix pass encdec args · 55884dae
  Ming Ding authored 3 years ago
  
  55884dae
- fix shared crossattn bug · 2721c2fa
  Ming Ding authored 3 years ago
  
  2721c2fa
Nov 23, 2021
- Merge branch 'package' of github.com:THUDM/SwissArmyTransformer into package · 233d9495
  Ming Ding authored 3 years ago
  
  233d9495
- add untest enc-dec and fix email · f191e5be
  Ming Ding authored 3 years ago
  
  f191e5be
- Add keyword arguments for forward_step · 49dea453
  Zhengxiao Du authored 3 years ago
  
  49dea453