Skip to content
GitLab
Explore
Sign in
Tags
Tags give the ability to mark specific points in history as being important
This project is mirrored from
https://github.com/lucidrains/voicebox-pytorch
. Pull mirroring updated
Sep 19, 2024
.
0.5.0
c05a4d0c
·
add a post layernorm for the gateloop layers, in case it is causing instability
·
Jan 31, 2024
0.4.12
cdc0777e
·
revert heinsen gateloop, unstable, patch
·
Jan 05, 2024
0.4.11
d52e37db
·
use heinsen sequence for gateloop
·
Dec 20, 2023
0.4.10
a0bcbe64
·
0.4.10
·
Dec 01, 2023
0.4.9
d079b26e
·
address a potential issue with convs and masking
·
Nov 30, 2023
0.4.8
fbc88587
·
0.4.8
·
Nov 28, 2023
0.4.7
cce475b7
·
bump
·
Nov 27, 2023
0.4.6
62e2890e
·
save on unnecessary gradient synchronizations
·
Nov 27, 2023
0.4.5
0a59a31f
·
turn off mixed precision when applying rotary
·
Nov 25, 2023
0.4.4
3c0544e2
·
0.4.4
·
Nov 25, 2023
0.4.3
86d13109
·
patch
·
Nov 22, 2023
0.4.2
ca8482ba
·
ability to use jax fused associative scan for gateloop layer
·
Nov 20, 2023
0.4.1
60ca79c3
·
cite
·
Nov 19, 2023
0.4.0
943f9f6a
·
upgrade feedforward to glu variant + dropouts
·
Oct 09, 2023
0.3.1
0dc7ea29
·
0.3.1
·
Oct 06, 2023
0.3.0
7ce0e56e
·
start adopting qk norm for attention, with option to turn off
·
Oct 05, 2023
0.2.6
c4ec2382
·
fix unconditional
·
Oct 05, 2023
0.2.5
403493bf
·
fix validation loop for multi gpu
·
Oct 05, 2023
0.2.3
974f43d7
·
memories should not have relative positions with each other, just far away from main tokens
·
Oct 02, 2023
0.2.2
9261e864
·
make sure one can still do 0 register tokens, in case paper is flawed in some way
·
Oct 02, 2023
Prev
1
2
3
4
Next