Skip to content
GitLab
Explore
Sign in
Tags
Tags give the ability to mark specific points in history as being important
This project is mirrored from
https://github.com/lucidrains/x-transformers
. Pull mirroring updated
Sep 19, 2024
.
0.0.15
a2387091
·
bump
·
Nov 04, 2020
0.0.14
6749bc2b
·
add talking heads feature, turned on with `attn_talking_heads = True`
·
Nov 04, 2020
0.0.12
0f14deda
·
complete encoder / decoder
·
Nov 04, 2020
0.0.11
6a9b1083
·
add T5 relative positional bias
·
Nov 04, 2020
0.0.10
e4773e22
·
simplify returning of embeddings or logits
·
Nov 04, 2020
0.0.9
7b1d4db5
·
rename layer blocks to attn layers
·
Nov 03, 2020
0.0.7
74848054
·
multiply by token embedding weight for logits by default
·
Nov 03, 2020
0.0.6
11a90584
·
add feedforward GLU variant and scalenorm
·
Nov 03, 2020
0.0.5
77a25e51
·
expose dim head, show how simple gpt3 is
·
Nov 03, 2020
0.0.4
a398a5b4
·
always fix head dimension at 64, so users do not trip up with improper ratio of dimension to heads
·
Nov 03, 2020
0.0.3
0dfba29a
·
deploy
·
Nov 03, 2020
0.0.2
a5686c3b
·
complete masking
·
Nov 01, 2020
0.0.1
7d45c6e7
·
first commit of full enc/dec
·
Oct 28, 2020
Prev
1
…
17
18
19
20
21
Next