cpp

🔧🔗https://github.com/andrewkchan/yalm

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

🔧🔗https://github.com/QwenLM/qwen.cpp C++ implementation of Qwen-LM

🔧🔗https://github.com/gpustack/llama-box

LM inference server implementation based on llama.cpp.

https://github.com/janhq/cortex.onnx