New microscaling data formats supported in Blackwell and Triton(triton-lang.org)

3 pointsby opcode84letztes Jahr1 comments

New microscaling data formats supported in Blackwell and Triton

https://triton-lang.org/main/getting-started/tutorials/10-block-scaled-matmul.html

1 comments

opcode84letztes Jahr

The formats supported in the tutorial are the OCP microscaling formats, including mxfp4 and mxfp8, as well as NVIDIA’s nvfp4 format. These matrix multiplications are accelerated by fifth generation tensor core instructions on CUDA devices with compute capability 10.

Blog post: https://developer.nvidia.com/blog/openai-triton-on-nvidia-bl...