Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

benchdnn: add more timers to get better profiling information for regular validation runs #2933

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

dzarukin
Copy link
Contributor

Add time per test case (asterisk-ed):

create: --matmul --dt=s8:u8:f16 --attr-scales=src:common:0.25+dst:common:2+wei:common:0.5 896x2048:2048x4096_n"RNN-T:Encoder_cell3_Input*1"
run: --matmul --dt=s8:u8:f16 --attr-scales=src:common:0.25+dst:common:2+wei:common:0.5 896x2048:2048x4096_n"RNN-T:Encoder_cell3_Input*1"
run ref: --matmul --attr-scales=src:common:0.25+dst:common:2+wei:common:0.5 896x2048:2048x4096_n"RNN-T:Encoder_cell3_Input*1"
4120:PASSED **(17054 ms)** __REPRO: --matmul --dt=s8:u8:f16 --attr-scales=src:common:0.25+dst:common:2+wei:common:0.5 896x2048:2048x4096_n"RNN-T:Encoder_cell3_Input*1"

Added execute and create timers into the summary breakdown (asterisk-ed):

total: 499.34s; **create_pd: 0.45s (0%);** **create_prim: 0.70s (0%);** fill: 5.03s (1%); **execute: 342.40s (69%);** compute_ref: 146.15s (29%); compare: 2.67s (1%);

@dzarukin dzarukin requested review from a team as code owners March 21, 2025 20:01
@dzarukin
Copy link
Contributor Author

make test

@github-actions github-actions bot added component:graph-api Codeowner: @oneapi-src/onednn-graph component:tests Codeowner: @oneapi-src/onednn-arch labels Mar 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component:graph-api Codeowner: @oneapi-src/onednn-graph component:tests Codeowner: @oneapi-src/onednn-arch
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants