llm-inference

https://github.com/mistralai/mistral-inference Official inference library for Mistral models

mistral.ai/

AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models https://github.com/noco-ai/spellbook-docker/wiki