IR Metrics
Traditional TREC ad-hoc Metric:
- Mean Average Precision (MAP) using TREC_EVAL
- Created assessment pools for each topic using top 100 of all retrieval runs
- Mean pool size: 596 (2.1% of all segments)
- Min pool size: 209
- Max pool size: 1309
- NIST assessors created reference relevance assessments from topic pools
- Somewhat artificial for boundary unknown conditions
-