Comment on Scalable MatMul-Free Language ModelingComments−sva_2yThe FPGA in question, Intel FPGA PAC D5005 seems to cost around $8k−mmoskal2yThe FPGA would be only to prove the transistor efficiency. If this works people will eventually do ASICs (possibly inside the GPUs a few generations ahead).−ein0p2yThat’s still 1/4th of an H100.
Comments
The FPGA in question, Intel FPGA PAC D5005 seems to cost around $8k
The FPGA would be only to prove the transistor efficiency. If this works people will eventually do ASICs (possibly inside the GPUs a few generations ahead).
That’s still 1/4th of an H100.