Agreed; there is that risk. We often do company lunches anyway - so to mitigate things what I say is "guys, today is actually a company lunch day so if you'd like to join us and chat to some of the current employee's then feel free - no pressure, it's not part of the interview. If anything we see this as your chance to ask questions."