I learnt this lesson already during the university, worse you could even lock your screen, but there were xhost and VT access that could also be used for some fun, if the default security settings were left on their original state.