MXFP4 Support #9579
Description
🚀 Feature
Support MXFP4, the format used in the GPT OSS models.
Motivation
This would allow people to train models more efficiently on TPU.
Pitch
Support MXFP4 just like any other format.
{{ message }}
Support MXFP4, the format used in the GPT OSS models.
This would allow people to train models more efficiently on TPU.
Support MXFP4 just like any other format.