10/10/06

[trec15pats.txt and trec15docs.txt] are generation of Perl patterns for the main task factoid patterns, as well as a list of each document that was judged to contain a correct (R) answer.  The Local, Inexact, and Unsupported judgments were not incorporated into this pattern list.  A few questions have more than one line for their patterns, where I thought it would be useful to distinguish the associated document sets.  The pattern list includes the factoid answers not found by any system, with the documents as given in the evaluation results.  I did not check to see if these answers appeared verbatim in the source documents.

In the patterns, the question number is separated from the pattern by a space.  In the document list, the question number is given, followed by a tab, the pattern, another tab, and a space-separated list of the document numbers.

When anonymized answers are provided for the list questions, the other questions, and the ciQA questions, I'll try to cobble together some similar lists.

Enjoy,

    Ken
-- 
Ken Litkowski                     TEL.: 301-482-0237
CL Research                       EMAIL: ken@clres.com
9208 Gue Road
Damascus, MD 20872-1025 USA       Home Page: http://www.clres.com