That seems like a failure to define success in the first place.

You are in precise agreement with the article's own text: "So when a startup comes to me with an idea for an experiment, the one thing I tell them is: make sure that there’s a well-defined distinction between success and failure."