Do you get the ability to move the execution point back to before the the error, in order to resume execution?

You can in Visual Studio 2012 and in Visual 2015 some corner cases were fixed.

Just drag the arrow backwards with the mouse.