Comment on Making floating point math highly efficient for AI hardwareComments−saagarjha7yI find it interesting that they were able to find improvements even on hardware that is presumably optimized for IEEE-754 floating point numbers.−nestorD7yIt is a trade-of : they find improvements by losing precision where they believe it is not useful for their use case.
Comments
I find it interesting that they were able to find improvements even on hardware that is presumably optimized for IEEE-754 floating point numbers.
It is a trade-of : they find improvements by losing precision where they believe it is not useful for their use case.