That principle might be a good rule of thumb, but it's not universally true. Sometimes a new model comes along that both explains more and is more accurate. General Relativity is an example. Fundamental physics is funny that way.