Because he doesn't know, like so many people on HN, that you can just build smaller models and let them be steered by a bigger model. Everyone thinks you need a trillion parameter model or the model is worthless.
It's the same problem with semiconductor manufacturing, where only the bleeding edge counts when in reality you need a whole spectrum of fabs.
Comments
What makes you say this?
Because he doesn't know, like so many people on HN, that you can just build smaller models and let them be steered by a bigger model. Everyone thinks you need a trillion parameter model or the model is worthless.
It's the same problem with semiconductor manufacturing, where only the bleeding edge counts when in reality you need a whole spectrum of fabs.