Comment on Microsoft's AI shopping announcement contains hallucinations in the demoparentComments−cubefox3yThat model is not state of the art. Even GPT-3.5 can answer this question.−sorokod3yOn GPT 3.5Q: "What is the seventy fourth element of the periodic table?"A: "The seventy-fourth element of the periodic table is Rhenium..."But this is really shooting fish in a barrel. Given the way LLMs work why would you expect them to provide factually correct text completion?−geoduck143yLlama2, when fine-tuned, can be better than GPT3.5Source: a trusted coworker
Comments
That model is not state of the art. Even GPT-3.5 can answer this question.
On GPT 3.5
Q: "What is the seventy fourth element of the periodic table?"
A: "The seventy-fourth element of the periodic table is Rhenium..."
But this is really shooting fish in a barrel. Given the way LLMs work why would you expect them to provide factually correct text completion?
Llama2, when fine-tuned, can be better than GPT3.5
Source: a trusted coworker