List Task

Return to the TREC
 home page TREC home Return to the TREC

Data home page Data home          National Institute
of Standards and Technology Home Page

List Task

The TREC 2001 QA track had an additional task call the list task. In the list task, the questions specified a target number of instances to retrieve and the response was an (unordered) list of no more than that many items. For example, one question in the task was "What are 9 novels written by John Updike?", and the response was to be the titles of 9 Updike novels. The list task requires a *set* of answers to be judged as a whole; thus there is not the equivalent of a main task judgment set or pattern set for this task. The "original answers" file below contains a list of the answers the assessors found as they were creating the questions.

TREC 2001 list task test questions

TREC 2001 list task top docs ranked list (.gz)

TREC 2001 list task original answers




Last updated: Thursday, 12-Feb-2015 14:08:54 MST
Date created: Tuesday, 23-April-02
trec@nist.gov