Comment on Updating a 50 terabyte PostgreSQL database (2018)parentComments−idiocrat4yOne question to ask is if they truly need all the 50 TB data in one database instance at once.Some old inactive data can be moved into partitions, then detached and moved to a different DB instance, as an archiving step.It reads like their processed payments (5000 tx/second) are very suitable for daily, monthly, yearly archiving.For analytics, a summary stab can be kept in place of the detailed (archived) transactions.For statutory reporting, the slow archives can be accessed on demand.
Comments
One question to ask is if they truly need all the 50 TB data in one database instance at once.
Some old inactive data can be moved into partitions, then detached and moved to a different DB instance, as an archiving step.
It reads like their processed payments (5000 tx/second) are very suitable for daily, monthly, yearly archiving.
For analytics, a summary stab can be kept in place of the detailed (archived) transactions.
For statutory reporting, the slow archives can be accessed on demand.