L

llmops

🔧🔗https://github.com/tensorzero/tensorzero TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation

https://github.com/distantmagic/paddler Stateful load balancer custom-tailored for llama.cpp