Question Answering Track
Goal: encourage research into systems that return answers, rather than document lists
Task:
- for each of 693 fact-based, short-answer questions, return ranked list of up to 5 [document-id, response-string] pairs
- documents: set of news articles on Disks 1-5
- responses limited to either 50 or 250 bytes
- evaluation: mean reciprocal rank of correct response