Skip to content

Commit 31f6b3d

Browse files
authored
update doc for using one socket with latency hint instead of one numa node (#28227)
### Details: - *update doc for using one socket with latency hint instead of one numa node* ### Tickets: - *ticket-id*
1 parent 9ab2c1a commit 31f6b3d

File tree

1 file changed

+14
-14
lines changed

1 file changed

+14
-14
lines changed

docs/articles_en/openvino-workflow/running-inference/inference-devices-and-modes/cpu-device/performance-hint-and-thread-scheduling.rst

+14-14
Original file line numberDiff line numberDiff line change
@@ -63,19 +63,19 @@ the model precision and the ratio of P-cores and E-cores.
6363

6464
Then the default settings for low-level performance properties on Windows and Linux are as follows:
6565

66-
+--------------------------------------+-----------------------------------------------------------------------+-----------------------------------------------------------------------+
67-
| Property | Windows | Linux |
68-
+======================================+=======================================================================+=======================================================================+
69-
| ``ov::num_streams`` | 1 | 1 |
70-
+--------------------------------------+-----------------------------------------------------------------------+-----------------------------------------------------------------------+
71-
| ``ov::inference_num_threads`` | is equal to the number of P-cores or P-cores+E-cores on one numa node | is equal to the number of P-cores or P-cores+E-cores on one numa node |
72-
+--------------------------------------+-----------------------------------------------------------------------+-----------------------------------------------------------------------+
73-
| ``ov::hint::scheduling_core_type`` | :ref:`Core Type Table of Latency Hint <core_type_latency>` | :ref:`Core Type Table of Latency Hint <core_type_latency>` |
74-
+--------------------------------------+-----------------------------------------------------------------------+-----------------------------------------------------------------------+
75-
| ``ov::hint::enable_hyper_threading`` | No | No |
76-
+--------------------------------------+-----------------------------------------------------------------------+-----------------------------------------------------------------------+
77-
| ``ov::hint::enable_cpu_pinning`` | No / Not Supported | Yes except using P-cores and E-cores together |
78-
+--------------------------------------+-----------------------------------------------------------------------+-----------------------------------------------------------------------+
66+
+--------------------------------------+--------------------------------------------------------------------+--------------------------------------------------------------------+
67+
| Property | Windows | Linux |
68+
+======================================+====================================================================+====================================================================+
69+
| ``ov::num_streams`` | 1 | 1 |
70+
+--------------------------------------+--------------------------------------------------------------------+--------------------------------------------------------------------+
71+
| ``ov::inference_num_threads`` | is equal to the number of P-cores or P-cores+E-cores on one socket | is equal to the number of P-cores or P-cores+E-cores on one socket |
72+
+--------------------------------------+--------------------------------------------------------------------+--------------------------------------------------------------------+
73+
| ``ov::hint::scheduling_core_type`` | :ref:`Core Type Table of Latency Hint <core_type_latency>` | :ref:`Core Type Table of Latency Hint <core_type_latency>` |
74+
+--------------------------------------+--------------------------------------------------------------------+--------------------------------------------------------------------+
75+
| ``ov::hint::enable_hyper_threading`` | No | No |
76+
+--------------------------------------+--------------------------------------------------------------------+--------------------------------------------------------------------+
77+
| ``ov::hint::enable_cpu_pinning`` | No / Not Supported | Yes except using P-cores and E-cores together |
78+
+--------------------------------------+--------------------------------------------------------------------+--------------------------------------------------------------------+
7979

8080
.. note::
8181

@@ -96,7 +96,7 @@ Then the default settings for low-level performance properties on Windows and Li
9696
Starting from 5th Gen Intel Xeon Processors, new microarchitecture enabled new sub-NUMA clusters
9797
feature. A sub-NUMA cluster (SNC) can create two or more localization domains (numa nodes)
9898
within a socket by BIOS configuration.
99-
By default OpenVINO with latency hint uses single NUMA node for inference. Although such
99+
By default OpenVINO with latency hint uses single socket for inference. Although such
100100
behavior allows to achive best performance for most of the models, there might be corner
101101
cases which require manual tuning of ``ov::num_streams`` and ``ov::hint::enable_hyper_threading parameters``.
102102
Please find more detail about `Sub-NUMA Clustering <https://www.intel.com/content/www/us/en/developer/articles/technical/xeon-processor-scalable-family-technical-overview.html>`__

0 commit comments

Comments
 (0)