Common Elements among Tasks
Document collection
- news articles from disks 1-5
Response unit
- [docid, answer-string] pair
- answer string limited to 50 bytes
- document must support answer
Answer Judging
- opinion of NIST assessors
- incorrect, unsupported, correct
- answers must be responsive to be correct