monitoring-tool

OpenLIT is an open-source LLM Observability tool built on OpenTelemetry. 📈🔥 Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions along with complete APM for LLM Apps. 🖥️

🔧🔗https://github.com/ncarlier/apimon

APImon is a simple tool for monitoring HTTP endpoints and sending metrics to a robust monitoring platform (such as TICK, Prometheus, ELK, etc.).

https://github.com/openlit/helm Helm Charts to deploy and manage OpenLIT in Kubernetes