Eight questions were eliminated from the TREC 2001 main
task test set for scoring purposes. These include questions
1004, 1009, 1134, 1176, 1206, 1336, 1378, and 1386.
Forty-nine questions have no known correct answer in
the document set. For these questions, "NIL" was
accepted as the correct response: 901, 906, 909, 924, 931,
938, 955, 965, 972, 978, 987, 990, 995, 1001, 1003, 1015,
1023, 1028, 1039, 1048, 1054, 1062, 1086, 1089, 1092, 1098, 1111,
1115, 1141, 1150, 1178, 1191, 1193, 1201, 1217, 1226, 1227, 1251,
1259, 1269, 1333, 1338, 1344, 1350, 1351, 1363, 1376, 1388, 1392.
TREC 2001 main task test questions
TREC 2001 main task top docs ranked list (.gz)
TREC 2001 main task judgment set
TREC 2001 main task pattern set
The pattern set for the TREC 2001 main task questions
was created by Ken Litkowski of CL Research.
TREC 2001 main task original answers
This file lists the answers the assessors found during question
development when they sought answers in the document collection.
NOTE: some answers are blank because the assessors did not
find answers. However, not all of the questions with
blank answers here have NIL as the correct response:
participants found correct answers in the collection for
some of these questions.