If you have ever used the Hailo-8 AI acceleration module, you may have used its integrated on-board telemetry for measuring power and temperature. It is fully integrated into their API, and just works out of the box, making benchmarking easy and reproducible.Unfortunately, not all AI accelerator vendors have this functionality available. Some only measure temperature, others nothing at all.In this series, we will explore how to achieve a similar level of power measurement independently.Series: Edge AI Power BenchmarkingBut first, let’s dive into Hailo’s power and temperature monitoring solution.Hailo’s Power Measurement SolutionHailo has included an INA device on-board the Hailo-8 M.2 acceleration module. This allows the host to measure power across a shunt resistor that is placed in series with the power rail.From my personal observations and research, I’m guessing that the device is a Texas Instruments INA231, for the following reasons:it has a 1.8V-compatible I2C interface, which would match the Hailo-8’s 1.8V I/Oit supports 0-28V sensing from a 3.3V supply, which is the voltage available on M.2 modulesit is available in a very small packageWhether I have this correct or not is not really important for this discussion.This functionality is available via their Python API:It is also available via their hailortcli utility with the benchmark sub-command, as we will see in the next section.Reproducing the Hailo Model Zoo throughput benchmark resultsIf we run a benchmark on the resnet50 model:(hailo_virtualenv) $ wget https://hailo-model-zoo.s3.eu-west-2.amazonaws.com/ModelZoo/Compiled/v2.18.0/hailo8/resnet_v1_50.hef--2026-05-01 11:32:40-- https://hailo-model-zoo.s3.eu-west-2.amazonaws.com/ModelZoo/Compiled/v2.18.0/hailo8/resnet_v1_50.hefResolving hailo-model-zoo.s3.eu-west-2.amazonaws.com (hailo-model-zoo.s3.eu-west-2.amazonaws.com)... 3.5.245.56, 52.95.150.158, 52.95.143.110, ...Connecting to hailo-model-zoo.s3.eu-west-2.amazonaws.com (hailo-model-zoo.s3.eu-west-2.amazonaws.com)|3.5.245.56|:443... connected.HTTP request sent, awaiting response... 200 OKLength: 17978284 (17M) [binary/octet-stream]Saving to: ‘resnet_v1_50.hef’resnet_v1_50.hef 100%[=======================>] 17.14M 7.39MB/s in 2.3s 2026-05-01 11:32:43 (7.39 MB/s) - ‘resnet_v1_50.hef’ saved [17978284/17978284]We can not only reproduce the Hailo Model Zoo benchmarks, but also measure the power consumption of the Hailo-8 in our local system.(hailo_virtualenv) $ hailortcli benchmark resnet_v1_50.hef Starting Measurements...Measuring FPS in HW-only modeNetwork resnet_v1_50/resnet_v1_50: 100% | 20577 | FPS: 1371.25 | ETA: 00:00:00Measuring FPS (and Power on supported platforms) in streaming mode[HailoRT] [warning] Using the overcurrent protection dvm for power measurement will disable the overcurrent protection.If only taking one measurement, the protection will resume automatically.If doing continuous measurement, to enable overcurrent protection again you have to stop the power measurement on this dvm.Network resnet_v1_50/resnet_v1_50: 100% | 20580 | FPS: 1371.43 | ETA: 00:00:00Measuring HW LatencyNetwork resnet_v1_50/resnet_v1_50: 100% | 3685 | HW Latency: 3.39 ms | ETA: 00:00:00=======Summary=======FPS (hw_only) = 1371.26 (streaming) = 1371.44Latency (hw) = 3.39388 msDevice 0000:c6:00.0: Power in streaming mode (average) = 3.96043 W (max) = 3.98996 W(hailo_virtualenv) $ hailortcli benchmark resnet_v1_50.hef Starting Measurements...Measuring FPS in HW-only modeNetwork resnet_v1_50/resnet_v1_50: 100% | 20577 | FPS: 1371.26 | ETA: 00:00:00Measuring FPS (and Power on supported platforms) in streaming mode[HailoRT] [warning] Using the overcurrent protection dvm for power measurement will disable the overcurrent protection.If only taking one measurement, the protection will resume automatically.If doing continuous measurement, to enable overcurrent protection again you have to stop the power measurement on this dvm.Network resnet_v1_50/resnet_v1_50: 100% | 20580 | FPS: 1371.44 | ETA: 00:00:00Measuring HW LatencyNetwork resnet_v1_50/resnet_v1_50: 100% | 3648 | HW Latency: 3.39 ms | ETA: 00:00:00=======Summary=======FPS (hw_only) = 1371.27 (streaming) = 1371.45Latency (hw) = 3.38907 msDevice 0000:c6:00.0: Power in streaming mode (average) = 4.06172 W (max) = 4.09325 WWe have faithfully reproduced the 1372 FPS benchmark published by Hailo. The benchmarking utility conducts three phases: