I feel like this advice works really well in some places and really poorly in others.

I think those using safe languages and broad frameworks have a much greater ability to execute on "keep it simple" than those who use something like C and build 100% of their code in-house.