Comment on Three-LLM: Three.js-based WebGPU LLM inference engineparentComments−bhoustonOP8dThreeJs has an abstraction that allows you to write your shaders using JavaScript, it is called ThreeJS Shading Language. This implementation makes of that to simplify development:https://github.com/mrdoob/three.js/wiki/Three.js-Shading-Lan...−anematode8dThat makes very little sense when you can just use WebGPU and have fine-grained control...for something like LLM inference, having this kind of abstraction seems like quite a hindrance−bhoustonOP8dOkay. I will give a raw WebGPU implementation a try and see if it is smaller and more efficient.
Comments
ThreeJs has an abstraction that allows you to write your shaders using JavaScript, it is called ThreeJS Shading Language. This implementation makes of that to simplify development:
https://github.com/mrdoob/three.js/wiki/Three.js-Shading-Lan...
That makes very little sense when you can just use WebGPU and have fine-grained control...
for something like LLM inference, having this kind of abstraction seems like quite a hindrance
Okay. I will give a raw WebGPU implementation a try and see if it is smaller and more efficient.