Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CPU] Add script for benchmark average counters aggregation #25652

Conversation

EgorDuplensky
Copy link
Contributor

@EgorDuplensky EgorDuplensky commented Jul 19, 2024

Example output:
Node type Count Sum (ms) %
FullyConnected 197 77.812 91.77
ScaledDotProductAttentionWithKVCache 28 3.7 4.36
RoPE 56 0.687 0.81
Reorder 161 0.473 0.56
Multiply 31 0.443 0.52
Transpose 56 0.431 0.51
PowerStatic 115 0.313 0.37
Add 59 0.227 0.27
ReduceMean 57 0.15 0.18
ReadValue 56 0.134 0.16
Reshape 200 0.114 0.13
Broadcast 6 0.092 0.11
Convert 8 0.092 0.11
Ceiling 2 0.029 0.03
Select 2 0.022 0.03
Concat 6 0.019 0.02
Gather 6 0.015 0.02
Unsqueeze 2 0.01 0.01
Clamp 2 0.009 0.01
Range 1 0.009 0.01
Less 1 0.005 0.01
Abs 1 0.004 0
ShapeOf 3 0.004 0
Constant 745 0 0
Assign 56 0 0
Parameter 4 0 0
Result 1 0 0
Total 1862 84.794 100

@EgorDuplensky EgorDuplensky requested review from a team as code owners July 19, 2024 17:04
@EgorDuplensky EgorDuplensky requested review from akuporos, AlexKoff88 and akopytko and removed request for a team July 19, 2024 17:04
@github-actions github-actions bot added category: CPU OpenVINO CPU plugin category: docs OpenVINO documentation category: dependency_changes Pull requests that update a dependency file labels Jul 19, 2024
@EgorDuplensky EgorDuplensky force-pushed the add_sum_average_counters_script branch 2 times, most recently from 1a425f1 to 6f77ec7 Compare July 21, 2024 19:27
@EgorDuplensky EgorDuplensky force-pushed the add_sum_average_counters_script branch from 6f77ec7 to f945acb Compare August 29, 2024 18:07
@dmitry-gorokhov dmitry-gorokhov added this to the 2024.5 milestone Aug 30, 2024
@dmitry-gorokhov
Copy link

Sounds like such aggregation should be part of benchmark_app itself. However I don't mind to have it in our tools.

@dmitry-gorokhov dmitry-gorokhov added this pull request to the merge queue Aug 30, 2024
Merged via the queue into openvinotoolkit:master with commit d622afe Aug 30, 2024
141 checks passed
@dmitry-gorokhov dmitry-gorokhov deleted the add_sum_average_counters_script branch August 30, 2024 07:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: CPU OpenVINO CPU plugin category: dependency_changes Pull requests that update a dependency file category: docs OpenVINO documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants