llamacpp

https://github.com/janhq/jan Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM) 🔗 https://jan.ai

https://github.com/distantmagic/resonance PHP Framework designed to build IO-intensive web applications. 🔗 http://resonance.distantmagic.com/

https://github.com/janhq/jan Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)