pre-trained-language-models

https://github.com/THUDM/SwissArmyTransformer SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

https://github.com/THUDM/P-tuning A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.