I bought an MP3-playing PCB for $3 or so. You do need to do some light soldering (it came without a headphone jack connector IIRC) and maybe print a case for it, but you can have a dirt-cheap, very simple iPod-shuffle-like MP3 player in half an hour.