Filtering Track
- Task: for each document in a document stream, decide whether to retrieve it in response to a standing query
- collection:
- AP documents (different training, test sets depending on subtask)
- Topics 1-50 (TREC-1 topics)
- routing (rank a new document set, training set)
- batch filtering (binary decision, training set)
- adaptive filtering (binary decision, on-line training)
- set evaluation
- utility functions: 2R+ - 2N+, 4R+ - N+
- average set precision: recall?precision
-