Well, "at all costs" is used as a colloquy to mean "as much as possible". Sometimes it isn't possible of course, but managers and developers owe it to themselves to make better decisions many times.

I think the worst offender I see is in developers when it comes to this - many tend to cut time and be afraid of exploring something new.