QA List Task
Goal: force systems to assemble an answer from multiple sources
Instance-finding task
- 25 questions that specified a target number of instances to retrieve
- Name 4 U.S. cities that have a “Shubert” theater
- What are 9 novels written by John Updike?
- response is an unordered set of the target number of instances
- an instance is a single [docid, answer-string] pair