Comment on Microsoft's AI shopping announcement contains hallucinations in the demoparentComments−sorokod3yI get different answers every time to "what is the third element in the periodic table" from llama2.I'll hold off actually using them for now.−cubefox3yThat model is not state of the art. Even GPT-3.5 can answer this question.−sorokod3yOn GPT 3.5Q: "What is the seventy fourth element of the periodic table?"A: "The seventy-fourth element of the periodic table is Rhenium..."But this is really shooting fish in a barrel. Given the way LLMs work why would you expect them to provide factually correct text completion?−geoduck143yLlama2, when fine-tuned, can be better than GPT3.5Source: a trusted coworker
Comments
I get different answers every time to "what is the third element in the periodic table" from llama2.
I'll hold off actually using them for now.
That model is not state of the art. Even GPT-3.5 can answer this question.
On GPT 3.5
Q: "What is the seventy fourth element of the periodic table?"
A: "The seventy-fourth element of the periodic table is Rhenium..."
But this is really shooting fish in a barrel. Given the way LLMs work why would you expect them to provide factually correct text completion?
Llama2, when fine-tuned, can be better than GPT3.5
Source: a trusted coworker