Variants
Assessors given a list of questions & asked to form equivalent questions
- assessors not given answers
- goal was to have both true semantic equivalence and natural phrasing
- 193 variants total for 54 originals
- between 1 and 7 new questions per original
- each variant set judged by same assessor, but scored independently