Nitro

Project information

https://github.com/janhq/nitro.git now: https://github.com/janhq/cortex.git Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

Synthetic In... cuda Llama accellerated inference-en... openai-api Large Langua... stable-diffu... llamacpp llama2 llama3 gguf tensorrt-llm

2,229 Commits
885 Branches
346 Tags

README
Apache License 2.0
CONTRIBUTING

Created on

January 23, 2024

Loading

🐾❤️ Strive to be the person your dogs believe you are ❤️🐾