Unranked Recall/Precision
Cannot use just recall or just precision
- uncontrolled set size is problem per query
- averaging over queries is a major problem
- e.g., consider system that knows if a query is easy or hard
- retrieves 1 document for easy queries and 20,000 documents for hard queries
- get average of .5 recall, .5 precision for totally unreasonable approach