2003 QA Main Task

Return to the TREC
 home page TREC home Return to the TREC

Data home page Data home          National Institute
of Standards and Technology Home Page

Main Task

Thirty questions had no known correct response in the document set. 'NIL' was accepted as the correct response for these questions:
1924, 1951, 1977, 1979, 1990, 2019, 2031, 2043, 2051, 2054, 2063, 2079, 2081, 2118, 2126, 2142, 2144, 2157, 2162, 2166, 2206, 2213, 2220, 2245, 2259, 2279, 2298, 2316, 2343, 2368

Test questions
Ranked list of top docs per question
Factoid judgements
def answers.txt
list answers.txt

Ken Litkowski submitted the following perl patterns for the factoid questions of the main QA track and the documents in which they appear, based on the correct answers (marked with a 1) in the judgment set. The patterns are minimal in that they cover the judgments, but do not insure "exact" answers as they have been defined. The two files contain patterns and documents for the 18 questions with no correct response in the judgment set; these are even less than unofficial.

Last updated: Friday, 25-Aug-2017 11:36:03 MDT
Date created: Wednesday, 12-Feb-03