What I wasn’t told was that we had 70,000 hard-coded references to Sacramento
There's plenty of real world scenarios that could have taken out that data center and the Twitter engineering team would have been scrambling to fix, just the same.
I read somewhere once that v1 of chaos monkey was the Netflix CEO randomly pulling cables in a data center to prove the point that systems needed rugged designs. Not all too different.
I regularly show off my work as an SRE by hard-terminating a machine in my client's AWS infrastructure. If everything is right, there's no impact - I pull up their products and test them as I'm doing so.
It's a great test and if you do it with enough confidence it really sells your skills.
Comments
There's plenty of real world scenarios that could have taken out that data center and the Twitter engineering team would have been scrambling to fix, just the same.
I read somewhere once that v1 of chaos monkey was the Netflix CEO randomly pulling cables in a data center to prove the point that systems needed rugged designs. Not all too different.
I regularly show off my work as an SRE by hard-terminating a machine in my client's AWS infrastructure. If everything is right, there's no impact - I pull up their products and test them as I'm doing so.
It's a great test and if you do it with enough confidence it really sells your skills.