L

llama-cpp-python

https://github.com/Woolverine94/biniou a self-hosted webui for 30+ generative ai

llama.cpp Connector

🔧🔗https://github.com/fidecastro/llama-cpp-connector Super simple Python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL, QVQ). Compile llama.cpp and run

ComfyUI Llama.cpp Client Node

🔧🔗https://github.com/fidecastro/comfyui-llamacpp-client ComfyUI client for llama-server from llama.cpp