Main Task

Return to the TREC
 home page TREC home Return to the TREC

Data home page Data home          National Institute
of Standards and Technology Home Page

Main Task

Eight questions were eliminated from the TREC 2001 main task test set for scoring purposes. These include questions 1004, 1009, 1134, 1176, 1206, 1336, 1378, and 1386. Forty-nine questions have no known correct answer in the document set. For these questions, "NIL" was accepted as the correct response: 901, 906, 909, 924, 931, 938, 955, 965, 972, 978, 987, 990, 995, 1001, 1003, 1015, 1023, 1028, 1039, 1048, 1054, 1062, 1086, 1089, 1092, 1098, 1111, 1115, 1141, 1150, 1178, 1191, 1193, 1201, 1217, 1226, 1227, 1251, 1259, 1269, 1333, 1338, 1344, 1350, 1351, 1363, 1376, 1388, 1392.

TREC 2001 main task test questions

TREC 2001 main task top docs ranked list (.gz)

TREC 2001 main task judgment set

TREC 2001 main task pattern set
The pattern set for the TREC 2001 main task questions was created by Ken Litkowski of CL Research.

TREC 2001 main task original answers
This file lists the answers the assessors found during question development when they sought answers in the document collection. NOTE: some answers are blank because the assessors did not find answers. However, not all of the questions with blank answers here have NIL as the correct response: participants found correct answers in the collection for some of these questions.




Last updated: Thursday, 12-Feb-2015 20:54:17 UTC
Date created: Tuesday, 23-April-02
trec@nist.gov