Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

SwissArmyTransformer
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Iterations
- Wiki
- Environments
- Terraform modules
- Incidents
- Service Desk

Snippets Groups Projects

4e0e9674

Commit 4e0e9674 authored 3 years ago by duzx16

Downloads
- Patches
- Plain Diff

Implement T5 Attention with attention_fn

parent 91afa917

No related branches found

No related tags found

No related merge requests found

Changes 3

Hide whitespace changes

Inline Side-by-side

Showing

SwissArmyTransformer/model/cached_autoregressive_model.py 15 additions, 13 deletions

SwissArmyTransformer/model/cached_autoregressive_model.py
SwissArmyTransformer/model/t5_model.py 12 additions, 57 deletions

SwissArmyTransformer/model/t5_model.py
SwissArmyTransformer/mpu/transformer.py 21 additions, 16 deletions

SwissArmyTransformer/mpu/transformer.py

with 48 additions and 86 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment

Strive to be the person your dogs believe you are