Correction, you have to do:

(set! unchecked-math true)

globally, wrapping in a binding like I did does nothing, since it needs to be set at compile time. My measurement were with it set globally.