This is an old-style directly connected power switch. If you release and re-press it quickly enough the power won't go out as there's still enough residual energy in the PSU capacitors. I used to do this all the time on my 486 as a sort of absent-minded tick.

I don't blame the guy for not trying that with a production SAP server though...