You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[Snippets][CPU] Disabled dynamic MHA tokenization if rtCache is not used (openvinotoolkit#26376)
### Details:
- *To reduce overheads of ShapeInference and CodeGeneration of dynamic
Subgraphs, CPU node Subgraph uses Runtime Cache of the plugin. If
Runtime Cache capacity is zero, dynamic subgraphs should not be
tokenized - it will lead to performance degradations. This PR disables
dynamic MHA tokenization if `config.rtCacheCapacity == 0`*
### Tickets:
- *150951*
0 commit comments