Read Neuromancer, it's where this term is from. More broadly it evokes images of something maybe the size of a Casio keyboard (or a little smaller) crammed with VR gear and compute, which you "jack in" to use.