Comment on Ask HN: Why is Generative AI non-deterministicparentComments−michaeljxOP1yA ok got it, the next token is sampled from a deterministic probability distribution, hence the random output. But why not get the token with the highest probability/weight? Is this to avoid some local minima?−minimaxir1yIt depends on your use case. Deterministic output is less "creative."
Comments
A ok got it, the next token is sampled from a deterministic probability distribution, hence the random output. But why not get the token with the highest probability/weight? Is this to avoid some local minima?
It depends on your use case. Deterministic output is less "creative."