The only person who seems to claim that Dyson Spheres were a "joke" is Angela Collier and people quoting her. I've seen no other source for this claim.

https://www.youtube.com/watch?v=huAIfzUoyhU&t=121s