llmops

https://github.com/distantmagic/paddler Stateful load balancer custom-tailored for llama.cpp

https://github.com/ComposioHQ/composio Composio equip's your AI agents & LLMs with 100+ high-quality integrations via function calling

https://github.com/distantmagic/llmops-handbook Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices.