Google’s own AI Overviews feature for Search has also repeatedly made mistakes, offering poor quality and inaccurate information at times.

I see this quoted over and over, but I've literally never seen it myself. I never trust it 100%, but usually its just summarizing the top search result. If its wrong, its generally because the result is wrong, which really isn't the AI's fault.