High Precision Track
- Task: find 15 good documents for a topic within 5 minutes wall clock time
- Same collection as ad hoc
- Evaluation: Prec(15), Relative Prec(15)
- Implicit assumption that users are experts with system --- gives upper bound on system performance
- Time limit selected such that intrinsic effectiveness, efficiency, and user interface all tested by the task