Comment on Rust SIMD on the GPUparentComments−Eridrus1moGiven the massive demand for GPUs for LLMs, what sorts of work do you expect to economically benefit from utilizing GPUs more?−LegNeato1moPart of our thesis is that decent GPUs are in every shipping device and most software doesn't use them and should.−Eridrus1moI guess you're looking at consumer hardware then since servers have exactly what you pay for.Can you say more about the application space you're targeting?
Comments
Given the massive demand for GPUs for LLMs, what sorts of work do you expect to economically benefit from utilizing GPUs more?
Part of our thesis is that decent GPUs are in every shipping device and most software doesn't use them and should.
I guess you're looking at consumer hardware then since servers have exactly what you pay for.
Can you say more about the application space you're targeting?