The entire apparatus sits in a cryostat (a fancy Thermos bottle) which is filled with liquid helium. In general, one supports things in liquid baths from above.