Comment on An Empirical Study of Mamba-Based Language ModelsparentComments−edflsafoiewq2yThe problem with LLMs is there's no apparent analytical theory and no way to scale up from small results. The only way to find out how fast the spaceship is is to build it, make the whole journey, and then see how long it took.
Comments
The problem with LLMs is there's no apparent analytical theory and no way to scale up from small results. The only way to find out how fast the spaceship is is to build it, make the whole journey, and then see how long it took.