AMD's Strix Halo has a 256-bit memory bus. Apple's Max class chips have a 512-bit memory bus, Ultra class chips have a 1024-bit memory bus. Unless you want to go for datacenter hardware, AMD's offerings simply aren't in the same league in terms of memory bandwidth.
Comments
Because bandwidth between those sticks and the GPU isn't fast enough for fast inference.
Even with an integrated gpu? Surely it'll be faster that using thunderbolt cables
both AMD and Apple hit the unified memory goal. but its the bandwith thats bottlenecking their performance and onboarc memory is even worse.
Is Apple in a better position than Amd as this article seems to claim?
AMD's Strix Halo has a 256-bit memory bus. Apple's Max class chips have a 512-bit memory bus, Ultra class chips have a 1024-bit memory bus. Unless you want to go for datacenter hardware, AMD's offerings simply aren't in the same league in terms of memory bandwidth.
I see, interesting thank you
depends: if they can keep getting larger memory, yes