Comment on Ask HN: Why is Generative AI non-deterministicComments−schoen1yIt's deliberately made nondeterministic, partly using something called softmaxhttps://en.wikipedia.org/wiki/Softmax_functionI'd say mainly in order to avoid boring its users.−minimaxir1ySoftmax just normalizes the logit outputs to be positive and sum to 1.0, it doesn't have an effect on determinism.−schoen1yThanks, I guess I confused its role with the adjacent step!
Comments
It's deliberately made nondeterministic, partly using something called softmax
https://en.wikipedia.org/wiki/Softmax_function
I'd say mainly in order to avoid boring its users.
Softmax just normalizes the logit outputs to be positive and sum to 1.0, it doesn't have an effect on determinism.
Thanks, I guess I confused its role with the adjacent step!