V

vllm

🔧🔗https://github.com/containers/ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all

Neuromancer 🔧🔗https://git.tomfos.tr/tom

Self-hosted, GPU-optimised GenAI platform providing a drop-in OpenAI-compatible API