In a series of studies, they examined self-assessment of logical reasoning skills, grammatical skills, and humor. After being shown their test scores, the subjects were again asked to estimate their own rank
This implies there's some reasonably objective test of humor. Does anyone know how that might work?
Well, I can tell you how Dunning and Kruger did it--they borrowed a bunch of jokes from various sources (famous comedians, joke books, &c.), then had some professional comedians rate the quality of the jokes. The assumption was that making a living in comedy probably requires being able to recognize when something is or isn't funny.
We created a 30-item questionnaire made up of jokes we felt were of varying comedic value. (...) To assess joke quality, we contacted several professional comedians via electronic mail and asked them to rate each joke on a scale ranging from 1 ( not at all funny ) to 11 ( very funny ). (...) Although the ratings provided by the eight comedians were moderately reliable ( a = .72), an analysis of interrater correlations found that one (and only one) comedian's ratings failed to correlate positively with the others (mean r = - .09). We thus excluded this comedian's ratings in our calculation of the humor value of each joke, yielding a final a of .76. Expert ratings revealed that jokes ranged from the not so funny (e.g., "Question: What is big as a man, but weighs nothing? Answer: His shadow." Mean expert rating = 1.3) to the very funny (e.g., "If a kid asks where rain comes from, I think a cute thing to tell him is 'God is crying.' And if he asks why God is crying, another cute thing to tell him is 'probably because of something you did.'" Mean expert rating = 9.6).
Comments
I found this part interesting:
In a series of studies, they examined self-assessment of logical reasoning skills, grammatical skills, and humor. After being shown their test scores, the subjects were again asked to estimate their own rank
This implies there's some reasonably objective test of humor. Does anyone know how that might work?
Well, I can tell you how Dunning and Kruger did it--they borrowed a bunch of jokes from various sources (famous comedians, joke books, &c.), then had some professional comedians rate the quality of the jokes. The assumption was that making a living in comedy probably requires being able to recognize when something is or isn't funny.
We created a 30-item questionnaire made up of jokes we felt were of varying comedic value. (...) To assess joke quality, we contacted several professional comedians via electronic mail and asked them to rate each joke on a scale ranging from 1 ( not at all funny ) to 11 ( very funny ). (...) Although the ratings provided by the eight comedians were moderately reliable ( a = .72), an analysis of interrater correlations found that one (and only one) comedian's ratings failed to correlate positively with the others (mean r = - .09). We thus excluded this comedian's ratings in our calculation of the humor value of each joke, yielding a final a of .76. Expert ratings revealed that jokes ranged from the not so funny (e.g., "Question: What is big as a man, but weighs nothing? Answer: His shadow." Mean expert rating = 1.3) to the very funny (e.g., "If a kid asks where rain comes from, I think a cute thing to tell him is 'God is crying.' And if he asks why God is crying, another cute thing to tell him is 'probably because of something you did.'" Mean expert rating = 9.6).
http://gagne.homedns.org/~tgagne/contrib/unskilled.html
I guess I would score poorly on this. I don't find most comedians very funny.
This joke goes to 11?