I like those folks (hello hboeck!), but their work are unrelated to determinstic LLM output, so why even bring them up here?
Did you read the blogpost in the OP?
I cannot understand what I wrote for you on your behalf. What could possibly be unclear about this? Or was this another rhetorical like the previous one, to polish your snark?
Yea are you even responding to me, or is this just a stream of thought?
Yes, I was. Are you able to ask non-rhetorical questions too? Should I have asked for your blessed permission to write more than just a direct address of what you asked about?
Comments
Nowhere. Does that make LLMs nondeterministic?
Did you read the blogpost in the OP?
I cannot understand what I wrote for you on your behalf. What could possibly be unclear about this? Or was this another rhetorical like the previous one, to polish your snark?
Yes, I was. Are you able to ask non-rhetorical questions too? Should I have asked for your blessed permission to write more than just a direct address of what you asked about?
It does, yes.
I can not reproduce the same output without access to the model.
Hence, not deterministic.
I see, that's a very entertaining way of reasoning about the determinism of an entire class of software, thanks for sharing.