T

transformer

🔧🔗https://github.com/vllm-project/vllm-ascend Community maintained hardware plugin for vLLM on Ascend

🔧🔗https://github.com/gpustack/llama-box

LM inference server implementation based on llama.cpp.