There's a lot of speculation that Roberts' vote swung the way it did because he was concerned about public perception of SCOTUS in general, and the Roberts Court legacy in particular.

It's apparently a 'well-known fact' at this point that Roberts switched his vote at the last minute on the ACA ruling.