Thing is, the nice snug fit of this device (its entire appeal) goes against frequently taking it out to store elsewhere.

I guess you could use it with two MicroSD cards to alternate back-ups, storing one at home, one at the office. But then the sole advantage would be that during the day, you're not bumping into it sticking out of your computer. I don't move my laptop around during the day often enough for that to be an issue.