Back to Openvino

Most Efficient Large Language Models for AI PC

docs/articles_en/about-openvino/performance-benchmarks/generative-ai-performance.rst

2026.1.22.9 KB
Original Source

Most Efficient Large Language Models for AI PC

This page is regularly updated to help you identify the best-performing LLMs on the Intel® Core™ Ultra processor family and AI PCs. The current data is as of OpenVINO 2026.0, 26 February 2026.

The tables below list the key performance indicators for inference on built-in GPUs.

.. tab-set::

.. tab-item:: 5-338H

  .. data-table::
     :class: modeldata stripe
     :name: supportedModelsTable_V1
     :header-rows: 1
     :file:  ../../_static/benchmarks_files/llm_models_5-338H.csv
     :data-column-hidden: [3,4,6]
     :data-order: [[ 0, "asc" ]]
     :data-page-length: 10

.. tab-item:: 7-255H

  .. data-table::
     :class: modeldata stripe
     :name: supportedModelsTable_V2
     :header-rows: 1
     :file:  ../../_static/benchmarks_files/llm_models_7-255H.csv
     :data-column-hidden: [3,4,6]
     :data-order: [[ 0, "asc" ]]
     :data-page-length: 10

.. tab-item:: 7-258V

  .. data-table::
     :class: modeldata stripe
     :name: supportedModelsTable_V3
     :header-rows: 1
     :file:  ../../_static/benchmarks_files/llm_models_7-258V.csv
     :data-column-hidden: [3,4,6]
     :data-order: [[ 0, "asc" ]]

.. tab-item:: 7-165H

  .. data-table::
     :class: modeldata stripe
     :name: supportedModelsTable_V4
     :header-rows: 1
     :file:  ../../_static/benchmarks_files/llm_models_7-165H.csv
     :data-column-hidden: [3,4,6]
     :data-order: [[ 0, "asc" ]]

.. grid:: 1 1 2 2 :gutter: 4

.. grid-item::

  All models listed here were tested with the following parameters:

  *  Framework: PyTorch
  *  Beam: 1
  *  Batch size: 1

.. grid-item::

  .. button-link:: https://docs.openvino.ai/2026/_static/download/benchmark_genai_platform_list.pdf
     :color: primary
     :outline:
     :expand:

     :material-regular:`download;1.5em` Get system descriptions [PDF]

  .. button-link:: ../../_static/benchmarks_files/llm_models_5-338H.csv 
     :color: primary
     :outline:
     :expand:

     :material-regular:`download;1.5em` Get the 5-338H table [PDF]

  .. button-link:: ../../_static/benchmarks_files/llm_models_7-258V.csv 
     :color: primary
     :outline:
     :expand:

     :material-regular:`download;1.5em` Get the 7-258V table [CSV]
  
  .. button-link:: ../../_static/benchmarks_files/llm_models_7-255H.csv 
     :color: primary
     :outline:
     :expand:

     :material-regular:`download;1.5em` Get the 7-255H table [CSV]

  .. button-link:: ../../_static/benchmarks_files/llm_models_7-165H.csv 
     :color: primary
     :outline:
     :expand:

     :material-regular:`download;1.5em` Get the 7-165H table [CSV]