2017 Real-time Summarization Track

Return to the TREC home page TREC home Return to the TREC
Data home page Data home          National Institute of Standards and Technology Home Page

TREC 2017
Track Web Page:

As before, the TREC 2017 tasks required participants to monitor the public Twitter API in real time. Thus no document set is available for this task.

Test set of profiles (in JSON)
Relevance judgments from NIST assessors for evaluation set (used by batch evaluation)
Clusters of equivalent relevant tweets (in JSON) used for batch evaluation
Batch eval epoch time file

Mobile assessor judgments
Mobile eval epoch time file

Evaluation script for Scenario A, Batch evaluation
Evaluation script for Scenario B, Batch evaluation
Evaluation script for Mobile evaluation

Last updated: Thursday, 08-Mar-2018 07:36:58 MST
Date created: March 7, 2018