If something like a phone is stolen it's probably safe just to change everything. The inconvenience of having to go through and change your important passwords manually (including your manager's master password of course) is relatively minor compared to your financial accounts getting breached.