Comment on Apple A20 Pro Geekbench ResultparentComments−bhouston19hI think the key AI improvement is that these chips double the memory bandwidth and this has been the main limit for AI performance recently, became LLMs do not fit into cache.−aurareturnOP19hThey should use LPDDR6 which is a sizable improvement but the other thing they can do is increase prompt processing even further.
Comments
I think the key AI improvement is that these chips double the memory bandwidth and this has been the main limit for AI performance recently, became LLMs do not fit into cache.
They should use LPDDR6 which is a sizable improvement but the other thing they can do is increase prompt processing even further.