When you average an learning algorithms performance over a whole bunch of domains that _NATURE WILL NEVER GENERATE_, all algorithms are equally bad.
Paying attention to the theorem is mostly defeatist and counter-productive.
Imagine some ads serving company improves their learning algorithms 10% and is making 100s of millions more dollars. Are you going to say, well, there are billions of other possible universes in which they'd be losing money, they just got lucky that we don't live in those universes?
So you're asserting that the 10% improvement by Supervision is because they used the raw RGB pixels. Is that right?
If so, then I'm guessing that the other teams only used compressed representations like Fisher vectors with linear classifiers, because they needed to scale. Instead, Supervision achieved scale with raw power, doing the training computations on GPUs for a week (probably coded in openCL).
"So you're asserting that the 10% improvement by Supervision is because they used the raw RGB pixels. Is that right?"
No, what I meant is that SuperVision did very well because their feature space is richer than the other teams, but IMHO that is resulting for the deep convolutional process which it used to generate rich features. This is a good explanation of the subject:
I deleted all the comments I could as they were complaining about the title. Since it was changed to a proper one most of my comments are not relevant any more.
Comments
Isn't NFL utter crap?
When you average an learning algorithms performance over a whole bunch of domains that _NATURE WILL NEVER GENERATE_, all algorithms are equally bad.
Paying attention to the theorem is mostly defeatist and counter-productive.
Imagine some ads serving company improves their learning algorithms 10% and is making 100s of millions more dollars. Are you going to say, well, there are billions of other possible universes in which they'd be losing money, they just got lucky that we don't live in those universes?
[deleted]
So you're asserting that the 10% improvement by Supervision is because they used the raw RGB pixels. Is that right?
If so, then I'm guessing that the other teams only used compressed representations like Fisher vectors with linear classifiers, because they needed to scale. Instead, Supervision achieved scale with raw power, doing the training computations on GPUs for a week (probably coded in openCL).
"So you're asserting that the 10% improvement by Supervision is because they used the raw RGB pixels. Is that right?"
No, what I meant is that SuperVision did very well because their feature space is richer than the other teams, but IMHO that is resulting for the deep convolutional process which it used to generate rich features. This is a good explanation of the subject:
http://ai.stanford.edu/~ang/papers/icml12-HighLevelFeaturesU...
I deleted all the comments I could as they were complaining about the title. Since it was changed to a proper one most of my comments are not relevant any more.