C

cpu

MacMon

https://github.com/vladkens/macmon 🦀⚙️ Sudoless performance monitoring for Apple Silicon processors. CPU / GPU / RAM usage, power consumption & temperature 🌡️

🔧🔗https://github.com/pytorch/serve

Serve, optimize and scale PyTorch models in production

🔧🔗https://github.com/modelscope/dash-infer

DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including x86 and ARMv9.