Assessor Opinions
- forcing agreement among TREC assessors doesn’t address problem
- deployed system will have users that won’t care about TREC assessing guidelines
- not possible, anyway
- do still need to be concerned about effect of errors on training
- lack of coherent user model for QA?
- questions not produced by assessor