Adam Smiths point is that you should stick to the production of whatever goods you have inherent comparative advantage at.

That doesn't mean you should be a mono-skilled person with only a bimodal work/consume life.

To be a rounded individual, you need to pick up skills in a lot of different fields, to the point of not being afraid of them. AT the very least, you'll be able to converse to a wide variety of people without feeling like a dumb schmuck.