Very interesting, but why change the button when it's time to "Go"? You could keep the arrow and just change the background color to green.

This will also allow me if I am distract to know where to go.