ContextQMD
Back to Openvino

OpenVINO coverage report build

docs/dev/test_coverage.md

2026.1.23.1 KB
Original Source

OpenVINO coverage report build

The coverage report is generated using Lcov tool and based on profile data generated by GCC. The generated reports are in HTML form and located in <openvino_build>/coverage. The reports are generated for the following components:

  1. inference - Inference component is a part of OpenVINO Runtime library.
  2. core - Core component is a part of OpenVINO Runtime library.
  3. low_precision_transformations - Low Precision transformations is a part of OpenVINO Runtime library.
  4. openvino_transformations - Common transformations is a part of OpenVINO Runtime library.
  5. snippets - OpenVINO snippets.
  6. OpenVINO open-source plugins:
    • hetero_plugin - Heterogeneous plugin.
    • auto_plugin - Auto plugin.
    • proxy_plugin - Proxy plugin.
    • auto_batch_plugin - Auto-batching plugin.
    • template_plugin - Template plugin.
    • intel_gpu_plugin - GPU plugin.
    • intel_cpu_plugin - CPU plugin.
    • intel_npu_plugin - Intel® NPU plugin.

Build with profiling data support

To build coverage report, compile OpenVINO with an additional CMake option -DENABLE_COVERAGE=ON:

bash
$ cmake -DENABLE_COVERAGE=ON .

And build OpenVINO as usual.

Generate coverage report

In order to generate coverage reports, first of all, the tests must be run. Depending on how many tests are run, the better coverage percentage can be achieved. E.g. for openvino component, InferenceEngineUnitTests, ieUnitTests, ieFuncTests must be run as well as plugin tests.

bash
$ ctest -V

OpenVINO components define several common groups which allow to run tests for separate component (with ctest argiment -L GROUP_NAME):

  • OV - core OpenVINO tests
  • IR_FE - IR frontend tests
  • ONNX_FE - ONNX frontend tests
  • PADDLE_FE - Paddle frontend tests
  • TF_FE - TensorFlow frontend tests
  • TFL_FE - TensorFlow Lite frontend tests
  • CPU - CPU plugin tests
  • GPU - GPU plugin tests
  • AUTO - Auto plugin tests
  • MULTI - Multi-device tests covered by the Auto plugin
  • AUTO_BATCH - Auto-batching plugin tests
  • PROXY - Proxy plugin tests
  • NPUW - Intel® NPU unit tests

After sufficient number of tests are executed, the coverage numbers can be calculated. In order to do this, run:

bash
$ make ov_coverage

The following tree of reports are generated:

bash
$ find coverage -maxdepth 2 -name index.html
coverage/auto_batch_plugin/index.html
coverage/auto_plugin/index.html
coverage/core/index.html
coverage/transformations/index.html
coverage/paddle_frontend/index.html
coverage/tf_frontend/index.html
coverage/openvino/index.html
coverage/onnx_frontend/index.html
coverage/ir_frontend/index.html
coverage/low_precision_transformations/index.html
coverage/proxy_plugin/index.html
coverage/template_plugin/index.html
coverage/inference/index.html
coverage/frontend_common/index.html
coverage/hetero_plugin/index.html
coverage/intel_cpu_plugin/index.html
coverage/intel_gpu_plugin/index.html
coverage/intel_npu_plugin/index.html

See also