Agreed, it's pretty rare that you'll need to turn it off. The default theming color selection does a good job making sure that lightness is different, so virtually all not-completely-custom-styled apps work with all kinds of color blindness.