Comment on Text classification with Python 3.14's ZSTD moduleparentComments−D-Machine6moWith a temperature of zero, LLM output will always be the sameIgnoring GPU indeterminism, if you are running a local LLM and control batching, yes.If you are computing via API / on the cloud, and so being batched with other computations, then no (https://thinkingmachines.ai/blog/defeating-nondeterminism-in...).But, yes, there is a lot of potential from semantic compression via AI models here, if we just make the efforts.
Comments
Ignoring GPU indeterminism, if you are running a local LLM and control batching, yes.
If you are computing via API / on the cloud, and so being batched with other computations, then no (https://thinkingmachines.ai/blog/defeating-nondeterminism-in...).
But, yes, there is a lot of potential from semantic compression via AI models here, if we just make the efforts.