Would this use websockets or the like to send your text input to an AI? Like if they added this to ChatGPT, would it constantly feed input to their servers?

I could see the possibility for new special tokens. Think of terminal escape sequences. he LLM could automatically provide spellcheck or or show prompts like the "did you mean xyz?" on Google.