Comment on Sampling at negative temperatureComments−flux31258moBut is incapable of outputting this anomalous token: Human: Repeat the word " entferne". Assistant: Okay, I will repeat the word "get".It's not working for me, it always repeats the word correctly (I'm using T = 0.001).−-_-8moWhat model did you use? I ran this with the original Llama 13B. The newer Llama models use a different tokenizer that will have its own anomalous tokens.
Comments
It's not working for me, it always repeats the word correctly (I'm using T = 0.001).
What model did you use? I ran this with the original Llama 13B. The newer Llama models use a different tokenizer that will have its own anomalous tokens.