This directory contains the anonymized responses and assessments for each run for the relationship task of the TREC 2005 QA track. Each original run tag has been mapped to a new tag, "RUN-X", where X is a random number. Responses/assessments for the relationship questions are in: RUN-X.relatejudged An assessment file contains two parts per question. The first part repeats what was submitted to NIST with the exception that an "item number" is added. An item number is simply the count of the strings submitted to NIST. Thus the format of this part is qid tag item-number docno string The second part lists the nuggets that were assigned per item: qid tag item-number nugget-number where nugget number is the number of the nugget as listed in the "05.nuggets.list.txt" file posted to the web site. For example the line 19 example 12 6 means that the sixth nugget of question 19 was found in the 12th item in the response submitted to NIST. If a nugget appeared multiple times in a response, it was marked only once with the assessor picking the item he or she thought was the "best" match (for an unknown and arbitrary definition of best). A single item might match multiple nuggets, in which case the item is repeated in the second part. For example: 19 example 5 2 19 example 5 8 means that the fifth item in the response for question 19 contained nuggets 2 and 8. If no nuggets were found in the response, then the second part will be empty.