L

llamacpp

https://github.com/janhq/jan Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM) 🔗 https://jan.ai

🔧🔗https://github.com/containers/ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all

https://github.com/distantmagic/paddler Stateful load balancer custom-tailored for llama.cpp

🔧🔗https://github.com/llmware-ai/llmware

Unified framework for building enterprise RAG pipelines with small, specialized models

🕸️🔗https://llmware-ai.github.io/llmware/

https://github.com/janhq/nitro.git now: https://github.com/janhq/cortex.git Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

https://github.com/distantmagic/resonance PHP Framework designed to build IO-intensive web applications. 🔗 http://resonance.distantmagic.com/

https://github.com/janhq/jan Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)