NIST Special Publication:
SP 500-302

The Twenty-Second Text REtrieval Conference
(TREC 2013) Proceedings

Return to the TREC home page TREC home    Return to the TREC Publications home page Publications home TREC 2013 Proceedings Track Index Indexed by Track   Return to the TREC Document Help home page Help

National Institute of Standards and Technology Home Page

NOTE: All papers are available in PDF format.

The inclusion or omission of a particular company or product implies neither endorsement nor criticism by NIST. Any opinions, findings, and conclusions or recommendations expressed in the individual papers are the authors' own and do not necessarily reflect those of the sponsors.


Overview Papers

  • PDF file Overview of the TREC 2013 Contextual Suggestion Track
    Adriel Dean-Hall, Charles L.A. Clarke, Nicole Simone, University of Waterloo
    Jaap Kamps, University of Amsterdam
    Paul Thomas, CSIRO
    Ellen Voorhees, NIST

  • PDF file Overview of the TREC 2013 Crowdsourcing Track
    Mark D. Smucker, University of Waterloo
    Gabriella Kazai, Microsoft Research, Cambridge
    Matthew Lease, University of Texas at Austin

  • PDF file Overview of the TREC 2013 Federated Web Search Track
    Thomas Demeester, Ghent Univesity
    Dolf Trieschnigg, Dong Nguyen, Djoerd Hiemstra, University of Twente

  • PDF file Evaluating Stream Filtering for Entity Profile Updates for TREC 2013
    John R. Frank, Steven J. Bauer, Max Kleiman­Weinre, Daniel A. Roberts, Nilesh Tripuraneni, Massachusetts Institute of Technology
    Ce Zhang, Stanford University
    Christopher Re, University of Wisconsin
    Ellen Voorhees, Ian Soboroff, NIST

  • PDF file Overview of the TREC-2013 Microblog Track
    Jimmy Lin and Miles Efron
    University of Maryland
    University of Illinois, Urbana-Champaign

  • PDF file Overview of the TREC 2013 Session Track
    Ben Carterette, Ashraf Bah, University of Delaware
    Evangelos Kanoulas, Google, Zurich
    Mark Hall, Edge Hill University
    Paul Clough, University of Sheffield

  • PDF file TREC 2013 Temporal Summarization
    Javed Aslam, Matthew Ekstrand-Abueg, Virgil Pavlu, Northeastern University
    Fernando Diaz, Microsoft Research
    Tetsuya Sakai, Waseda University

  • PDF file TREC 2013 Web Track Overview
    Kevyn Collins-Thompson, University of Michigan
    Paul Bennett, Fernando Diaz, Microsoft Research
    Charlie Clarke, University of Waterloo
    Ellen M. Voorhees, NIST

  • Participant Papers

  • PDF file Filtering Entity Centric Documents using Numerics and Temporals features within RF Classifier
    Vincent Bouvier, Patrice Bellot, Aix-Marseille Universite

  • PDF file Webis at TREC 2013--Session and Web Track
    Matthias Hagen, Michael Volske, Jakob Gomoll, Marie Bornemann, Lene Ganschow, Florian Kneist, Abdul Hamid Sabri, Benno Stein, Bauhaus-Universitat Weimar

  • PDF file DLDE at web track: ad-hoc task
    Jie Chen, Zhendong Niu, Yulong Shi, Changmin Zhang, Weiyin Li, Beijing Institute of Technology

  • PDF file BIT and MSRA at TREC KBA CCR Track 2013
    Jingang Wang, Dandan Song, Lejian Liao, Beijing Institute of Technology
    Chin-Yew Lin, Microsoft Research Asia

  • PDF file PRIS at TREC2013 Knowledge Base Acceleration Track
    Chunyun Zhang, Weiran Xu, Ruifang Liu, Weitai Zhang, Dai Zhang, Janshu Ji, Jing Yang, Beijing University of Posts and Telecommunications

  • PDF file The Information Extraction Systems of PRIS at Temporal Summarization Track
    Chunyun Zhang, Weiyan Xu, Fanyu Meng, Hongyan Li, Tong Wu, Lixin Xu,Beijing University of Posts and Telecommunications

  • PDF file PRIS at TREC 2013 Microblog Track
    Siming Zhu, Zhe Gao, Yajing Yuan, Hui Wang, Guang Chen, Beijing University of Posts and Telecommunications

  • PDF file BJUT at TREC 2013 Microblog Track
    Zhen YANG, Guangyuan ZHANG, Shuyong SI, Yingxu LAI, Kefeng FAN, Beijing University of Technology

  • PDF file BJUT at TREC 2013 Temporal Summarization Track
    Zhen YANG, Fei YAO, Huayang SUN, Yun ZHAO, Yingxu LAI, Kefeng FAN, Beijing University of Technology

  • PDF file CWI and TU Delft Notebook TREC 2013: Contextual Suggestion, Federated Web Search, KBA, and Web Tracks
    Alejandro Bellogin, Gebrekirstos G. Gebremeskel, Jiyin He, Alan Said, Thaer Samar, Arjen P. de Vries, Centrum Wiskunde en Informatica
    Jimmy Lin, University of Maryland
    Jeroen B. P. Vuurens, Delft University of Technology

  • PDF file ICTNET at Context Suggestion Track TREC 2013
    Bingyang Liu, Yanqin Zhong, Chinese Academy of Sciences and University of Chinese Academy of Sciences
    Yue Liu, Dayong Wu, Chinese Academy of Sciences
    Xueqi Cheng, University of Chinese Academy of Sciences

  • PDF file ICTNET at Federated Web Search Track 2013
    Feng Guan, Yuanhai Xue, Chinese Academy of Sciences and University of Chinese Academy of Sciences
    Xiaoming Yu, Yue Liu, Chinese Academy of Sciences
    Xueqi Cheng, University of Chinese Academy of Sciences

  • PDF file ICTNET at Microblog Track in TREC 2013
    Jinhua Gao, Guoxin Cui, Chinese Academy of Sciences and University of Chinese Academy of Sciences
    Shenghua Liu, Yue Liu, Xueqi Cheng, Chinese Academy of Sciences

  • PDF file ICTNET at Session Track TREC 2013
    Zhenhong Chen, Long Xia, Chinese Academy of Sciences and University of Chinese Academy of Sciences
    Xiaoming Yu, Yue Liu, Xueqi Cheng, Chinese Academy of Sciences

  • PDF file ICTNET at Temporal Summarization Track TREC 2013
    Qian Liu, Chinese Academy of Sciences and University of Chinese Academy of Sciences
    Yue Liu, Dayong Wu, Xueqi Cheng, Chinese Academy of Sciences

  • PDF file ICTNET at Web Track 2013
    Yuanhai Xue, Feng Guan, Chinese Academy of Sciences and University of Chinese Academy of Sciences
    Xiaoming Yu, Yue Liu, Xueqi Cheng, Chinese Academy of Sciences

  • PDF file DUTH at TREC 2013 Contextual Suggestion Track
    George Drosatos, Giorgos Stamatelatos, Avi Arampatzis, Pavlos S. Efraimidis, Democritus University of Thrace and Athena Research & Innovation Center

  • PDF file Boosting Venue Page Rankings for Contextual Retrieval--Georgetown at TREC 2013 Contextual Suggestion Track
    Jiyun Luo, Hui Yang, Georgetown University

  • PDF file Applying the Query Change Retrieval Model on Session Search--Georgetown at TREC 2013 Session Track
    Sicong Zhang, Hui Yang, Georgetown University

  • PDF file Hrbust in TREC 2013: Crowdsourcing Track
    Li Peng, Sun Bo-yu, Liu Yang, Zhang Ting-ting, Harbin University of Science and Technology

  • PDF file A Simple Context Dependent Suggestion System
    Dwaipayan Roy, Ayan Bandyopadhyay, Mandar Mitra, Indian Statistical Institute

  • PDF file ISI at the TREC 2013 Federated task
    Dipasree Pal, Mandar Mitra, Indian Statistical Institute

  • PDF file IRIT, GeoComp, and LIUPPA at the TREC 2013 Contextual Suggestion Track
    Gilles Hubert, Guillaume Cabanac, Karen Pinel-Sauvagnat, University of Toulouse, IRIT
    Damien Palacio, University of Zurich
    Christian Sallaberry, University of Pau et des Pays de l'Adour

  • PDF file IRIT at TREC Knowledge Base Acceleration 2013: Cumulative Citation Recommendation Task
    Rafik Abbes, Karen Pinel-Sauvagnat, Nathalie Hernandez, Mohand Boughanem, IRIT

  • PDF file IRIT at TREC Microblog Track 2013
    Lamjed Ben Jabeur, Firas Damak, Lynda Tamine, Guillaume Cabanac, Karen Pinel-Sauvagnat, Mohand Boughanem, IRIT/SIG

  • PDF file Query Expansion for Microblog Retrieval: 2013
    Ayan Bandyopadhyay, ISI Kolkata

  • PDF file Application of Data Fusion in the Web Track
    Chunlan Huang, Shengli Wu, Jinbo Feng, Yongquan Tao, Yuping Xing, Jiangsu University

  • PDF file HLTCOE at TREC 2013: Temporal Summarization
    Tan Xu, Douglas W. Oard, University of Maryland College Park
    Paul McNamee, Johns Hopkins University HLTCOE

  • PDF file TREC 2013 Microblog Track Experiments at Kobe University
    Taiki Miyanishi, Sayaka Kitaguchi, Kazuhiro Seki, Kuniaki Uehara, Kobe University

  • PDF file Crowdsourcing for Robustness in Web Search
    Yubin Kim, Carnegie Mellon University
    Kevyn Collins-Thompson, University of Michigan
    Jaime Teevan, Microsoft Research

  • PDF file CIRGIRDISCO at TREC 2013 Contextual Suggestion Track: Using the Wikipedia Graph Structure for Item-to-Item Recommendation
    M. Atif Qureshi, Arjumand Younus,National University of Ireland Galway and University of Milan Bicocca
    Colm O'Riordan, National University of Ireland Galway
    Gabriella Pasi, University of Milan Bicocca

  • PDF file CIRGIRDISCO at TREC 2013 Microblog Track
    M. Atif Qureshi, National University of Ireland Galway and University of Milan Bicocca
    Colm O'Riordan, National University of Ireland Galway
    Gabriella Pasi, University of Milan Bicocca

  • PDF file Northeastern University Runs at the TREC13 Crowdsourcing Track
    Maryam Bashir, Jesse Anderton, Virgil Pavlu, Javed A. Aslam, Northeastern University

  • PDF file PKUICST at TREC 2013 Microblog Track
    Runwei Qiang, Yue Fei, Yihong Hong, Jianwu Yang, Peking University

  • PDF file QCRI at TREC 2013 Microblog Track
    Tarek El-Ganainy, Walid Magdy, Wei Gao, Qatar Computing Research Institute
    Zhongyu Wei, The Chinese University of Hong Kong

  • PDF file QU at TREC-2013: Expansion Experiments for Microblog Ad hoc Search
    Maram Hasanain, Latifa Al-Marri, Tamer Elsayed, Qatar University

  • PDF file A Pattern Matching Approach to Streaming Slot Filling
    Hung Nguyen, Yi Fang, Sandhya Gade, Vijay Mysore, Juan Hu, Sabita Pandit, Aparna Srinivasan, Miao Jiang, Santa Clara University

  • PDF file The Technion at TREC 2013 Web Track: Cluster-based Document Retrieval
    Fiana Raiber, Oren Kurland, Technion --- Israel Institute of Technology

  • PDF file NovaSearch at TREC 2013 Federated Web Search Track: Experiments with rank fusion
    Andre Mourao, Flavio Martins Joao Magalhaes, Universidade Nova de Lisboa

  • PDF file NovaSearch at TREC 2013 Microblog Track: Experiments with reranking using Wikipedia
    Flavio Martins, Andre Mourao, Joao Magalhaes, Universidade Nova de Lisboa

  • PDF file Universite de Montreal at TREC 2013: Experiments with Quantum Language Models in the Web Track
    Alessandro Sordoni, Wei Yuan, Jian-Yun Nie, Universite de Montreal

  • PDF file Filtering Documents over Time on Evolving Topics --- The University of Amsterdam at TREC 2013 KBA CCR
    Tom Kenter, University of Amsterdam

  • PDF file University of Amsterdam at the TREC 2013 Contextual Suggestion Track: Learning User Preferences from Wikitravel Categories
    Marijn Koolen, Hugo Huurdeman, Jaap Kamps, University of Amsterdam

  • PDF file UCAS at TREC-2013 Microblog Track
    Dongxing Li, Ben He, Xin Zhang, Tiejian Luo, University of Chinese Academy of Sciences

  • PDF file Tie-breaker: A New Perspective of Ranking and Evaluation for Microblog Retrieval
    Yue Wang, Jerry Darko, Hui Fang, University of Delaware

  • PDF file An Opinion-aware Approach to Contextual Suggestion
    Peilin Yang, Hui Fang, University of Delaware

  • PDF file Evaluating the Effectiveness of Axiomatic Approaches in Web Track
    Peilin Yang, Hui Fang, University of Delaware

  • PDF file A Related Entity based Approach for Knowledge Base Acceleration
    Xitong Liu, Jerry Darko, Hui Fang, University of Delaware

  • PDF file University of Florida Knowledge Base Acceleration
    Morteza Shahriari Nia, Christan Grant, Yang Peng, Daisy Zhe Wang, University of Florida
    Milenko Petrovic, IHMC

  • PDF file University of Glasgow (UoG_TwTeam) at TREC Microblog 2013
    Jesus A. Rodriguez Perez, Andrew J. McMinn, Joemon M. Jose, University of Glasgow

  • PDF file University of Glasgow at TREC 2013: Experiments with Terrier in Contextual Suggestion, Temporal Summarisation and Web Tracks
    Richard McCreadie, M-Dyaa Albakour, Stuart Mackie, Nut Limosopathan, Craig Macdonald, Iadh Ounis, University of Glasgow
    B. Taner Dincer, Mugla University

  • PDF file The University of Illinois' Graduate School of Library and Information Science at TREC 2013
    Miles Efron, Craig Willis, Peter Organisciak, Brian Balsamo, Ana Lucic, University of Illinois, Urbana-Champaign

  • PDF file University of Lugano at the TREC 2013 Contextual Suggestion Track
    Andrei Rikitianskii, Morgan Harvey, Fabio Crestani, University of Lugano

  • PDF file UMass at TREC 2013 Knowledge Base Acceleration Track: Bi-directional Entity Linking and Time-aware Evaluation
    Laura Dietz, Jeffrey Dalton, University of Massachusetts, Amherst

  • PDF file A User-in-the-Loop Process for Investigational Search: Foreseer in TREC 2013 Microblog Track
    Cheng Li, Yue Wang, Qiaozhu Mei, University of Michigan

  • PDF file A Nearest Neighbor Approach to Contextual Suggestion
    Sandeep Avula, John O'Connor, Jaime Arguello, University of North Carolina at Chapel Hill

  • PDF file University of Padua at TREC 2013: Federated Web Search Track
    Emanuele Di Buccio, Ivano Masiero, Massimo Melucci, University of Padua

  • PDF file PITT at TREC 2013 Contextual Suggestion Track
    Ming Jiang, Daqing He, University of Pittsburgh

  • PDF file Pitt at TREC 2013: Different Effects of Click-through and Past Queries on Whole-session Search Performance
    Jiepu Jiang, University of Massachusetts Amherst
    Daqing He, University of Pittsburgh

  • PDF file Collection and Document Langauge Models for Resrouce Selection
    Krisztian Balog, University of Stavanger

  • PDF file Mirex and Taily at TREC 2013
    Robin Aly, Djoerd Hiemstra, Dolf Trieschnigg, University of Twente
    Thomas Demeester, Ghent University

  • PDF file University of Waterloo at the TREC 2013 Temporal Summarization Track
    Gaurav Baruah, Rakesh Guttikonda, Adam Roegiest and Olga Vechtomova, University of Waterloo

  • PDF file Bootstrapping Knowledge Base Acceleration
    Tushar Khot, Ce Zhang, Jude Shavlik, University of Wisconsin-Madison
    Sriraam Natarajan, Indiana University
    Christopher Re, Stanford University

  • PDF file York University at TREC 2013: Contextual Suggestion Track
    Sushma Yalamarti, Mariam Daoud, Jimmy Huang, York University

  • PDF file ZZISTI at TREC2013 Temporal Summarization Track
    Yaoyi Xi, Bicheng Li, Jie Zhou, Yongwang Tang, Zhengzhou Information Science and Technology Institute

  • Appendix

    PDF file Appendix A Cover

    PDF file Common Evaluation Measures

    PDF file Contextual Suggestion Runs
    Contextual Suggestion Results

    PDF file Crowdsourcing Runs
    Crowdsourcing Results

    PDF file Federated Web Search Resource Selection Runs
    PDF file Federated Web Search Result Merging Runs
    Federated Web Search Results

    PDF file KBA CCR Runs
    PDF file KBA SSF Runs
    KBA Results

    PDF file Microblog Runs
    Microblog Results

    PDF file Session Runs
    Session Results

    PDF file Temporal Summarization Runs
    Temporal Summarization Results

    PDF file Web Runs
    Web Results


    Last updated: Monday, 15-Apr-2019 11:24:18 MDT
    Date created: February 28, 2014
    trec@nist.gov