Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rfc: proposal for block level APIs #1852

Merged
merged 7 commits into from
Mar 12, 2025

Conversation

mgouicem
Copy link
Contributor

@mgouicem mgouicem commented Apr 1, 2024

Proposal to expose block level API on CPU, namely brgemm and transforms.

Rendered version

@vpirogov vpirogov added the RFC A design document label Apr 1, 2024
Copy link

@jgong5 jgong5 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you also add sample code that uses the APIs to demonstrate the usage flow?

change the API when we introduce the feature, or add a placeholder
parameter if we are confident this feature will gain traction soon.

Also, note that currently, no kernel-level cache exists for block
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The caching support is a must for performance. Frameworks have to provide their own cache support if oneDNN doesn't support it. oneDNN supports it at the beginning would be ideal.


## Handling of attributes

First, here is the list of attributes we plan on exposing:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suggest adding ISA and accumulation_datatype as attributes as well for end-user to control.

@mgouicem mgouicem force-pushed the mgouicem/rfcs/brgemm branch from 03a286e to da0e72f Compare June 6, 2024 11:15
@mgouicem mgouicem force-pushed the mgouicem/rfcs/brgemm branch from da0e72f to 2de75d1 Compare June 6, 2024 11:19
@vpirogov vpirogov added this to the v3.5 milestone Jul 16, 2024
@dzarukin
Copy link
Contributor

Merge as functionality is available in the library.

@dzarukin dzarukin merged commit 5b8a2d0 into uxlfoundation:rfcs Mar 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
RFC A design document
Projects
None yet
Development

Successfully merging this pull request may close these issues.