The TREC 2001 QA track had an additional task call the list
task. In the list task, the questions specified a target
number of instances to retrieve and the response was
an (unordered) list of no more than that many items.
For example, one question in the task was "What are 9 novels
written by John Updike?", and the response was to be the titles
of 9 Updike novels. The list task requires a *set* of
answers to be judged as a whole; thus there is not the
equivalent of a main task judgment set or pattern set for
this task. The "original answers" file below contains
a list of the answers the assessors found as they were
creating the questions.
TREC 2001 list task test questions
TREC 2001 list task top docs ranked list (.gz)
list_topdocs.tar.gz
Contact lori.buckland (at) nist.gov to receive instructions for receiving access to this data.
TREC 2001 list task original answers