Comment on How has DeepSeek improved the Transformer architecture?parentComments−whimsicalism1yhallucinations decrease with scale and reasoning, the model just gets better and stops making stuff up.−littlestymaar1yo1 still hallucinates badly though.−Jerrrry1yFalse, facts only need to be seen once, and one mis-step in reasoning and your CoT is derailed.−whimsicalism1yone mis-step in reasoning and your CoT is derailed.tell me you've never seen reasoning traces without telling me
Comments
hallucinations decrease with scale and reasoning, the model just gets better and stops making stuff up.
o1 still hallucinates badly though.
False, facts only need to be seen once, and one mis-step in reasoning and your CoT is derailed.
tell me you've never seen reasoning traces without telling me