I think it's the memory which is the bottleneck more so than processing speed and the obvious levers to push on are:
- more memory efficient models
- a whole system approach to getting better performance out of a less capable model
- more memory
the memory crisis, Micron shutting down a beloved brand that built trust over almost 30 years, and all of that is an economic externalization of memory as the bottleneck.
Comments
I think it's the memory which is the bottleneck more so than processing speed and the obvious levers to push on are:
- more memory efficient models
- a whole system approach to getting better performance out of a less capable model
- more memory
the memory crisis, Micron shutting down a beloved brand that built trust over almost 30 years, and all of that is an economic externalization of memory as the bottleneck.