The biggest problem I see though is if you want to save a reference to the unregister functions of the $watch callbacks.

This is a valid criticism, thank you. I will try to put together a nice solution for this.

Of course you can always register/de-register watchers the normal way inside of the init method.