GPUStack

🔧🔗https://github.com/gpustack/gpustack.github.io

🔧🔗https://github.com/gpustack/gpustack

Manage GPU clusters for running LLMs

🔧🔗https://github.com/gpustack/gpustack-ui

UI for GPUStack

🔧🔗https://github.com/gpustack/gguf-parser-go

Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

🔧🔗https://github.com/gpustack/llama-box

LM inference server implementation based on llama.cpp.

🔧🔗https://github.com/gpustack/gguf-packer-go

Deliver LLMs of GGUF format via Dockerfile.