Source of Questions
Major impact on task
- increased realism
- much more ambiguous
Who is Colin Powell? What is the best-selling book?
- more difficult for systems
- more difficult for assessors
- TREC-8 questions not as representative for training
Who is Colin Powell? vs. Who invented the paper clip?