Comment on Float ExposedparentComments−elvircrn11moYes, all of them would be great.−lifthrasiir11moHmm, you successfully nerd-sniped me. AFAIK there are at least:- 8-bit floating point types: (S1)E4M3 (finite only, has no-negative-zero variant), (S1)E5M2 (has no-negative-zero variant), E8M0- 6-bit floating point types: (S1)E2M3, (S1)E3M2- 4-bit floating point types: (S1)E2M1, NF4- Block floating point types: MXFP8 (E5M2/E4M3*32+E8M0), MXFP6 (E3M2/E2M3*32+E8M0), MXFP4 (E2M1*32+E8M0), NXFP [1][1] https://arxiv.org/pdf/2412.19821Do you have anything to add on?−elvircrn11moNothing to add, I was simply saying that it would be useful to have an FP8 toy website out there covering all of these formats.
Comments
Yes, all of them would be great.
Hmm, you successfully nerd-sniped me. AFAIK there are at least:
- 8-bit floating point types: (S1)E4M3 (finite only, has no-negative-zero variant), (S1)E5M2 (has no-negative-zero variant), E8M0
- 6-bit floating point types: (S1)E2M3, (S1)E3M2
- 4-bit floating point types: (S1)E2M1, NF4
- Block floating point types: MXFP8 (E5M2/E4M3*32+E8M0), MXFP6 (E3M2/E2M3*32+E8M0), MXFP4 (E2M1*32+E8M0), NXFP [1]
[1] https://arxiv.org/pdf/2412.19821
Do you have anything to add on?
Nothing to add, I was simply saying that it would be useful to have an FP8 toy website out there covering all of these formats.