Maybe there’s something I don’t understand, but it seems to me that it would just be a streaming-next-token input instead of a batch input.