- List Task
The TREC 2001 QA track had an additional task call the list
task. In the list task, the questions specified a target
number of instances to retrieve and the response was
an (unordered) list of no more than that many items.
For example, one question in the task was "What are 9 novels
written by John Updike?", and the response was to be the titles
of 9 Updike novels. The list task requires a *set* of
answers to be judged as a whole; thus there is not the
equivalent of a main task judgment set or pattern set for
this task. The "original answers" file below contains
a list of the answers the assessors found as they were
creating the questions.
TREC 2001 list task test questions
TREC 2001 list task top docs ranked list (.gz)
TREC 2001 list task original answers
|