Final Answer
Systems asked to give one final answer: either a rank or “UNSURE”
- recognition that answer doesn’t exist in collection different task from recognizing system doesn’t know
- gather data for evaluation of systems that recognize when they don’t know
Not enough data to analyze
- more than half the systems always sure