L

llmops

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure. burr.dagworks.io

https://github.com/distantmagic/paddler Stateful load balancer custom-tailored for llama.cpp

https://github.com/distantmagic/llmops-handbook Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices.