I've jumped around it and didn't see any mention of cost/transistor going down. So I assume that isn't a respected engineer saying the opposite of what all the data clearly shows, and instead it's a hyped title to a talk about something slightly different.
This is one of the most respected engineers in the industry, he built chips for Intel, Amd64 and even Tesla chips. He talks about how there are lots of innovations at different places in cpu stack that keep giving performance gains. Even stuff like prediction of what future code will run, and run multiple copies in parrellel and only use the result of the computation that’s needed .
Cost of memory transistors has gone up on the last couple of nodes. NVIDIA has complained about it publicly.
Batteries are not on Moore's Law and more of our systems are battery powered so portable electronics is not on Moore's Law. Transistors are not cheaper if you can't turn them on.
Power goes as area squared and voltage squared. We can't turn voltage down any further and cheaper transistors mean area goes up. This means that most computation chips are fairly close to their thermal limits. Transistors are not cheaper if your cooling solution costs 10x more.
Comments
With enough funding, it's quite a good thing to work on. With Moore's law dead, the odds of success of weird chips got much better.
Jim Keller: Moore’s Law is Not Dead: https://www.youtube.com/watch?v=oIG9ztQw2Gc
I'm not watching a 1 hour video, sorry.
I've jumped around it and didn't see any mention of cost/transistor going down. So I assume that isn't a respected engineer saying the opposite of what all the data clearly shows, and instead it's a hyped title to a talk about something slightly different.
This is one of the most respected engineers in the industry, he built chips for Intel, Amd64 and even Tesla chips. He talks about how there are lots of innovations at different places in cpu stack that keep giving performance gains. Even stuff like prediction of what future code will run, and run multiple copies in parrellel and only use the result of the computation that’s needed .
Yep, that's what I got from jumping around the video, thanks for the confirmation.
None of that has any relation to Moore's law.
Cost of memory transistors has gone up on the last couple of nodes. NVIDIA has complained about it publicly.
Batteries are not on Moore's Law and more of our systems are battery powered so portable electronics is not on Moore's Law. Transistors are not cheaper if you can't turn them on.
Power goes as area squared and voltage squared. We can't turn voltage down any further and cheaper transistors mean area goes up. This means that most computation chips are fairly close to their thermal limits. Transistors are not cheaper if your cooling solution costs 10x more.