while denyhosts (or fail2ban just for ssh) is of extremely questionable benefit, it's not because using a non-standard port for ssh eliminates the need for it altogether.

Once the correct port is located, you're in precisely the same situation that you are if you hadn't moved ssh.