I've been thinking about this approach. How do you handle updates on this setup? For example, a status component that goes from "loading" to "success".
Does the LLM go back and modify the previous response, sending deltas to the client? Effectively changing the component from loading to success. Or is something else happening behind the scenes?
Comments
Really nice writeup!
I've been thinking about this approach. How do you handle updates on this setup? For example, a status component that goes from "loading" to "success".
Does the LLM go back and modify the previous response, sending deltas to the client? Effectively changing the component from loading to success. Or is something else happening behind the scenes?
The components are standard react components so once it is rendered they can set their own state and effects and load in their own data.
I hope I understood your question correctly?