It's not a contradiction. The anomalous events tell you to improve your model, so while your model yesterday was insufficient your model tomorrow will not be. If you're wondering why the model yesterday is not the best possible already, it's because you make guesses about what's important and what's not; guesses which are refined by correcting your model in the presence of anomalous events.
If you start with a weak model that doesn't contain all the knowledge you have available, your anomalies will contain many irrelevant or already known things. If you start with a strong model representing the best current understanding, then correcting the model is not so straightforward.
Suggesting any model that’s not 100% consistent with all known information is weak clearly misses the point. Models which can be automated in a reasonable timeframe on limited hardware beat those who can’t.
The goal is to find interesting things in the data, not simply take years of data and return “everything looks normal.”
Comments
It's not a contradiction. The anomalous events tell you to improve your model, so while your model yesterday was insufficient your model tomorrow will not be. If you're wondering why the model yesterday is not the best possible already, it's because you make guesses about what's important and what's not; guesses which are refined by correcting your model in the presence of anomalous events.
If you start with a weak model that doesn't contain all the knowledge you have available, your anomalies will contain many irrelevant or already known things. If you start with a strong model representing the best current understanding, then correcting the model is not so straightforward.
Suggesting any model that’s not 100% consistent with all known information is weak clearly misses the point. Models which can be automated in a reasonable timeframe on limited hardware beat those who can’t.
The goal is to find interesting things in the data, not simply take years of data and return “everything looks normal.”