Mostly it is just the caps that get filthy, so I remove them and let them soak for a few hours under room temperature water with some dishwasher liquid. A few swipes with a cloth does it for the base.

If I need to clean the insides, I use some canned air spray.