- Main Task
Thirty questions had no known correct response in the document set. 'NIL'
was accepted as the correct response for these questions:
1924, 1951, 1977, 1979, 1990, 2019, 2031, 2043, 2051, 2054,
2063, 2079, 2081, 2118, 2126, 2142, 2144, 2157, 2162, 2166,
2206, 2213, 2220, 2245, 2259, 2279, 2298, 2316, 2343, 2368
Test questions
Ranked list of top docs per question
Factoid judgements
def answers.txt
list answers.txt
Ken Litkowski submitted the following perl patterns for
the factoid questions of the
main QA track and the documents in which they appear, based on the correct
answers (marked with a 1) in the judgment set. The patterns are minimal
in that they cover the judgments, but do not insure "exact" answers as
they have been defined. The two files contain patterns and documents for
the 18 questions with no correct response in the judgment set; these are
even less than unofficial.
docs.txt
pats.txt
|