It's not exactly special insight, but presumably all the people involved have experienced a number of encounters with Ted whereas for flying saucers, it is generally the case that all parties to the conversation have not had a number of encounters with flying saucers

On top of that, there have also been many cases of believing incorrectly that somebody else is out of town.