Evaluating the Evaluation

• Appropriateness of the evaluation methodology

  • task implementation
  • use of human assessors

• Validity of the conclusions that can be drawn

• Goal: produce an equivalent to IR’s test collections

Previous slide

Next slide

Back to first slide

View graphic version