Did the results get published? Were the queries "external" or "user generated"? We found it very informative to compare the results of relevance testers (which were people who were shown a query and a set of results) with users (which were people who actually generated the query and evaluated the results). I had hoped to get a study done to get more data on that.
Comments
Did the results get published? Were the queries "external" or "user generated"? We found it very informative to compare the results of relevance testers (which were people who were shown a query and a set of results) with users (which were people who actually generated the query and evaluated the results). I had hoped to get a study done to get more data on that.