It seems like latency will be poor if you have to wait for a server-side round trip to an LLM to update the UI whenever you press a button?
In a context where you're chatting with an LLM, I suppose the user would expect some lag, but it would be unwelcome in regular apps.
This also means that a lot of other UI performance issues don't matter - form submission is going to be slow anyway, so just be transparent about the delay.
Comments
It seems like latency will be poor if you have to wait for a server-side round trip to an LLM to update the UI whenever you press a button?
In a context where you're chatting with an LLM, I suppose the user would expect some lag, but it would be unwelcome in regular apps.
This also means that a lot of other UI performance issues don't matter - form submission is going to be slow anyway, so just be transparent about the delay.