Fixed :) Turned out to be a race condition where the groq inference task completed before the sse client could subscribe to that inference, and internally the sse connection couldn't be used to fetch already completed inferences.