T

transformer

https://github.com/vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

https://github.com/vllm-project/vllm-ascend Community maintained hardware plugin for vLLM on Ascend

https://github.com/fishaudio/fish-speech Brand new TTS solution

https://github.com/takara-ai/go-attention

A full attention mechanism and transformer in pure go.

https://github.com/InternLM/MindSearch An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT) https://mindsearch.netlify.app/

Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

huggingface.co/transformers https://github.com/huggingface/transformers

https://github.com/THUDM/SwissArmyTransformer SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

https://github.com/gpustack/llama-box

LM inference server implementation based on llama.cpp.

https://github.com/forhaoliu/instructrl

Instruction Following Agents with Multimodal Transforemrs

This is a Jax implementation for the InstructRL method.

https://github.com/THUDM/CogView2 official code repo for paper "CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers"