iPod Nano is the device you're thinking of.

The iPod Nano with a particular after-market watch band was quite popular at the time.