Not self hosting, but way cheaper than 5-49 USD per month:

I had good experiences with Infomaniak. Their email service can be used while the domain is registered somewhere else.

1.50 EUR per month for 5 addresses and unlimited storage, modern interface + imap, carddav, caldav, hosted in CH.

https://www.infomaniak.com/en/hosting/service-mail