Utilyze
Utilyze measures how efficiently your GPU is doing useful work, not just whether it's busy. It runs live against your workload with negligible overhead.
Standard tools like nvidia-smi and nvtop only check whether a kernel is running on the GPU. They can show 100% while your workload is using a tiny fraction of the hardware's real capacity.
Utilyze reads GPU performance counters directly to show what's actually being used, and provides an estimate of how far you can push utilization given a workload, model, and hardware. To learn more, read our blog post.
Utilyze is created by Systalyze.
Read this in other languages: 中文
Requirements
Linux amd64 (arm64 support coming soon)
NVIDIA Ampere or newer GPU (A100, H100, H200, B200, RTX 3000+)
CUDA Toolkit 11.0+
... continue reading