Can assessors perform task?
Yes, but…
- assessors’ written comments and think-aloud sessions suggest that assessors understood their task and could do it
- giving credit for both a right answer when not supported by doc and wrong answer when supported by doc too weird
- assessors don’t like it
- doesn’t correspond to any true user task
- large source of inconsistency across assessors