The major innovation appears to be an efficient hardware implementation of diffusion generative AI.
Certainly not CUDA compatible.
Diffusion for code generation is way faster than transformer based methods but currently not preferred due to better problem solving ability of transformers.
Comments
Cool research board. I hope it works and in 15-20 years when they make it to production they will be epic.
Mind you, Cerebras is already in production: https://www.cerebras.ai/chip
This is how Cerebras is like 25x faster than nvidia.
The major innovation appears to be an efficient hardware implementation of diffusion generative AI.
Certainly not CUDA compatible.
Diffusion for code generation is way faster than transformer based methods but currently not preferred due to better problem solving ability of transformers.