T

transformer

🔧🔗https://github.com/vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

🔧🔗https://github.com/vllm-project/vllm-ascend Community maintained hardware plugin for vLLM on Ascend

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

huggingface.co/transformers https://github.com/huggingface/transformers

🔧🔗https://github.com/sgl-project/sglang

SGLang is a fast serving framework for large language models and vision language models.

🔧🔗https://github.com/SYSTRAN/faster-whisper

Faster Whisper transcription with CTranslate2

https://github.com/fishaudio/fish-speech Brand new TTS solution

🔧🔗https://github.com/manycore-research/PlankAssembly [ICCV 2023] PlankAssembly: Robust 3D Reconstruction from Three Orthographic Views with Learnt Shape Programs

🔧🔗https://github.com/takara-ai/go-attention

A full attention mechanism and transformer in pure go.

https://github.com/InternLM/MindSearch 🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT) 🔗 https://mindsearch.netlify.app/

🔧🔗https://github.com/gpustack/llama-box

LM inference server implementation based on llama.cpp.

https://github.com/THUDM/SwissArmyTransformer SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

🔧🔗https://github.com/forhaoliu/instructrl

Instruction Following Agents with Multimodal Transforemrs

This is a Jax implementation for the InstructRL method.

https://github.com/THUDM/CogView2 official code repo for paper "CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers"