If you set caching settings to the absolute minimum and use Postgres, it's not bad.

Though occasionally everything slows down and you have to run a query to cleanup (https://github.com/matrix-org/synapse/issues/1760#issuecomme...)