Performance Analysis Using ITT Counters

Contents

• Introduction
• Performance analysis
• Adding new ITT counters

Introduction

OpenVINO has a powerful capabilities for performance analysis of the key stages, such as read time and load time. Most of the modules and features have been tagged with Intel ITT counters, which allows us to measure the performance of these components.

Performance analysis

For performance analysis, follow the steps below:

1. Run the CMake tool with the following option: -DENABLE_PROFILING_ITT=FULL and build OpenVINO.

2. Choose the tool for statistics collection using ITT counters.

   1. Intel Vtune Profiler

3. Run an OpenVINO project with the performance analysis tool.

Intel Vtune Profiler

Example of running the tool:

vtune -collect hotspots -k sampling-mode=hw -k enable-stack-collection=true -k stack-size=0 -k sampling-interval=0.5 -- ./benchmark_app -nthreads=1 -api sync -niter 1 -nireq 1 -m ./resnet-50-pytorch/resnet-50-pytorch.xml

Mandatory parameters:

• -collect hotspots

Generated artifacts:

r000hs Generated file can be opened with Vtune client.

Adding new ITT counters

Use API defined in openvino/itt module.

See also

• OpenVINO™ README
• OpenVINO Core Components
• OpenVINO Plugins
• OpenVINO GPU Plugin
• OpenVINO CPU Plugin
• OpenVINO NPU Plugin
• Developer documentation