This criticism basically boils down to "what if the site is a bad actor/incompetent", which I guess is a legitimate concern, but would be just as meaningful of a criticism against basically any feature I can imagine. Alas we continue to have useful interactions with third parties despite this.