If you add a column and real customer data is written to that column, then "rolling back" means deleting it. That isn't a problem that can be "solved".