New microscaling data formats supported in Blackwell and Triton(triton-lang.org)

New microscaling data formats supported in Blackwell and Triton

https://triton-lang.org/main/getting-started/tutorials/10-block-scaled-matmul.html

1 comments

The formats supported in the tutorial are the OCP microscaling formats, including mxfp4 and mxfp8, as well as NVIDIA’s nvfp4 format. These matrix multiplications are accelerated by fifth generation tensor core instructions on CUDA devices with compute capability 10.

Blog post: https://developer.nvidia.com/blog/openai-triton-on-nvidia-bl...