I spent months, months of late nights watching commits to nvfuser and shit, I wrote a SASS decompiler instrumented everything trying to learn Blackwell.
This is the first time I've seen something so clean, just a real work of scholarship on it.
My hat is off to the authors and the contribution it represents.
If I would caution a reader anything it's that the 2CTA (sm_100 sm_110) patterns here are different on 1CTA in important ways and it's not a better / worse thing, they are good for different workloads.
Really outstanding work. I proves q lot of this in lean4 and published but I got lazy short of really doing the pedagogical work.
This is what you should be starting with if you want to max out 2CTA gear, it's immaculate.
Comments
I can't signal boost this enough.
I spent months, months of late nights watching commits to nvfuser and shit, I wrote a SASS decompiler instrumented everything trying to learn Blackwell.
This is the first time I've seen something so clean, just a real work of scholarship on it.
My hat is off to the authors and the contribution it represents.
If I would caution a reader anything it's that the 2CTA (sm_100 sm_110) patterns here are different on 1CTA in important ways and it's not a better / worse thing, they are good for different workloads.
Really outstanding work. I proves q lot of this in lean4 and published but I got lazy short of really doing the pedagogical work.
This is what you should be starting with if you want to max out 2CTA gear, it's immaculate.