Sure, Jeopardy is peculiar. Still, it's popular and well-understood, so an open competition, where anyone can upload their playing-agents (quirks and all) could draw big interest. It'd be more like recurring competitive computer chess tournaments than the stage-managed Watson-on-Jeopardy series.
Comments
Eh, Jeopardy success requires way too much Jeopardy-specific tuning. It has lots of quirks and conventions.
The data they use is much purer, and makes a much better evaluation for general-purpose QA technologies.
Sure, Jeopardy is peculiar. Still, it's popular and well-understood, so an open competition, where anyone can upload their playing-agents (quirks and all) could draw big interest. It'd be more like recurring competitive computer chess tournaments than the stage-managed Watson-on-Jeopardy series.