2017 Real-time Summarization Track
Return to the TREC home page TREC home Return to the TREC Data home page Data home          National Institute of Standards and Technology Home Page
TREC 2017
Track Web Page:
trecrts.github.io

As before, the TREC 2017 tasks required participants to monitor the public Twitter API in real time. Thus no document set is available for this task.

Test set of profiles (in JSON)
Relevance judgments from NIST assessors for evaluation set (used by batch evaluation)
Clusters of equivalent relevant tweets (in JSON) used for batch evaluation
Batch eval epoch time file

Mobile assessor judgments
Mobile eval epoch time file

Evaluation script for Scenario A, Batch evaluation
Evaluation script for Scenario B, Batch evaluation
Evaluation script for Mobile evaluation

Last updated: Thursday, 08-Mar-2018 09:36:58 EST
Date created: March 7, 2018
trec@nist.gov