Skip to content

amd bf16 gpu float support#2859

Open
i-chaochen wants to merge 1 commit into
r2.18-rocm-enhancedfrom
r2.18-float-support
Open

amd bf16 gpu float support#2859
i-chaochen wants to merge 1 commit into
r2.18-rocm-enhancedfrom
r2.18-float-support

Conversation

@i-chaochen

Copy link
Copy Markdown
Collaborator

No description provided.

@draganmladjenovic draganmladjenovic left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should probably not do this.

@i-chaochen

Copy link
Copy Markdown
Collaborator Author

We should probably not do this.

any reason why?

@pemeliya

Copy link
Copy Markdown

To better align MI300 and H100 HLO dumps, I have enabled these bf16 arithm ops on 0.5.0 branch to test this big HLO attached to: https://ontrack-internal.amd.com/browse/SWDEV-515395
But it looks like, it ran a bit slower then with ordinary f32 conversions.

@i-chaochen

Copy link
Copy Markdown
Collaborator Author

Yes, actually from the customer workloads, this makes performance worse..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants