Comment on MicroGPT-C in pure C hits 10M TPS on Apple M5Comments−gok25dIt could probably go quite a bit faster using Arm SME. The entire network could fit into the ZA register.
Comments
It could probably go quite a bit faster using Arm SME. The entire network could fit into the ZA register.