I hypothesize that invasive species will come to refer to those species that we just don't like or whose function we find annoying or dangerous

Isn't that already what "noxious weed" means?