metrics

https://github.com/roboflow/supervision We write your reusable computer vision tools. 💜

OpenLIT is an open-source LLM Observability tool built on OpenTelemetry. 📈🔥 Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions along with complete APM for LLM Apps. 🖥️

🔧🔗https://github.com/tubearchivist/tubearchivist-metrics

Optional service for the TubeArchivist project to export metrics for users who run prometheus/grafana

https://github.com/Lightning-AI/torchmetrics Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications. 🔗 https://lightning.ai/docs/torchmetrics/