NIST Special Publication:
SP 500-331

The Twenty-Eighth Text REtrieval Conference
(TREC 2019) Proceedings

Return to the TREC home page TREC home    Return to the TREC Publications home page Publications home TREC 2019 Proceedings Track Index Indexed by Track   Return to the TREC Document Help home page Help

National Institute of Standards and Technology Home Page

NOTE: All papers are available in PDF format.

The inclusion or omission of a particular company or product implies neither endorsement nor criticism by NIST. Any opinions, findings, and conclusions or recommendations expressed in the individual papers are the authors' own and do not necessarily reflect those of the sponsors.


Overview Papers

  • PDF file TREC CAR Y3: Complex Answer Retrieval Overview
    Laura Dietz - University of New Hampshire
    John Foley - Smith College

  • PDF file CAsT 2019: The Conversational Assistance Track Overview
    Jeffrey Dalton - University of Glasgow
    Chenyan Xiong - Microsoft Research
    Jamie Callan - Carnegie Mellon University

  • PDF file Overview of the TREC 2019 Decision Track
    Mustafa Abualsaud, Mark D. Smucker - University of Waterloo
    Christina Lioma and Maria Maistro - University of Copenhagen
    Guido Zuccon - University of Queensland

  • PDF file Overview of the TREC 2019 Deep Learning Track
    Nick Craswell, Bhaskar Mitra and Daniel Campos - Microsoft AI and Research
    Emine Yilmaz - University College London
    Ellen M. Voorhees - NIST

  • PDF file Overview of the TREC 2019 Fair Ranking Track
    Asia J. Biega and Fernando Diaz - Microsoft Research Montréal
    Michael D. Ekstrand - Boise State University
    Sebastian Kohlmeier - Allen Institute for Artificial Intelligence

  • PDF file TREC 2019 News Track Overview
    Ian Soboroff, Shudong Huang, and Donna Harman - NIST

  • PDF file Overview of the TREC 2019 Precision Medicine Track
    Kirk Roberts - The University of Texas Health Science Center
    Dina Demner-Fushman - U.S. National Library of Medicine
    Ellen M. Voorhees - National Institute of Standards and Technology
    William R. Hersh and Steven Bedrick - Oregon Health & Science University
    Alexander J. Lazar, Shubham Pant, and Funda Meric-Bernstam - The University of Texas MD Anderson Cancer Center

  • Participant Papers

  • PDF file [ADAPT-DCU] DCU at the TREC 2019 Conversational Assistance Track
    Piyush Arora, Abhishek Kaushik, and Gareth J. F. Jones - Dublin City University

  • PDF file [BITEM_DL] SIB Text Mining at TREC 2019 Deep Learning Track: Working Note
    Julien Knafou, Matt Jeffryes, Luc Mottin, Douglas Teodoro and Patrick Ruch - HES-SO / HEG Geneva and SIB Text Mining, Swiss Institute of Bioinformatics

  • PDF file [BITEM_PM] Designing retrieval models to contrast precision-driven ad hoc search vs. recall-driven treatment extraction in Precision Medicine
    Déborah Caucheteur, Emilie Pasche, Julien Gobeill, Anaïs Mottaz, Luc Mottin and Patrick Ruch - HES-SO / HEG Geneva and SIB Text Mining, Swiss Institute of Bioinformatics

  • PDF file [Brown] Brown University at TREC Deep Learning 2019
    George Zerveas, Ruochen Zhang, Leila Kim and Carsten Eickhoff - Brown University

  • PDF file [Brown] Brown University at TREC Precision Medicine 2019
    Abdullah Ahmed, Gil Alon, Bashar Zaidat, Isaac Nathoo, Hwai-Liang Tung, Charles Wang and Carsten Eickhoff - Brown University

  • PDF file [cbnu] CBNU at TREC 2019 Incident Streams Track
    Won-Gyu Choi and Kyung-Soon Lee - RCAIT Chonbuk National University

  • PDF file [cbnu] CBNU at TREC 2019 Precision Medicine Track
    Seung-Hyeon Jo and Kyung-Soon Lee - RCAIT Chonbuk National University

  • PDF file [CCNL] SCUT-CCNL at TREC 2019 Precision Medicine Track
    Xiaofeng Liu, Lu Li, Zuoxi Yang, and Shoubin Dong - South China University of Technology

  • PDF file [CCNU_IRGroup] CCNU_IRGroup @ TREC 2019 Deep Learning Track
    Hao Hu, Junmei Wang, Xinhui Tu, and Tingting He - Central China Normal University

  • PDF file [CFDA_CLIP] Query and Answer Expansion from Conversation History
    Jheng-Hong Yang, Sheng-Chieh Lin and Chuan-Ju Wang - Academia Sinica
    Jimmy Lin - University of Waterloo
    Ming-Feng Tsai - National Chengchi University

  • PDF file [CincyMedIR] Retrieving Scientific Abstracts using Venue- and Concept-based Approaches: CincyMedIR at TREC 2019 Precision Medicine Track
    Danny T.Y. Wu, and Wu-Chen Su, and James J. Lee - University of Cincinnati

  • PDF file [cityuni] DMINR at TREC News Track
    Sondess Missaoui, Andrew MacFarlane, Stephann Makri and Marisela Gutierrez-Lopez - University of London

  • PDF file [CLAC_NEWS] The CLaC System at the TREC 2019 News Track
    Pavel Khloponin and Leila Kosseim - Concordia University

  • PDF file [CMU] A Step towards Context Identification for Conversational Search
    Vaibhav Kumar and Jamie Callan - Carnegie Mellon University

  • PDF file [CMU] An Evaluation of Weakly-Supervised DeepCT in the TREC 2019 Deep Learning Track
    Zhuyun Dai and Jamie Callan - Carnegie Mellon University

  • PDF file [CMU] Proximity-Based Entity Ranking
    Gustavo Gonçalves and João Magalhães - NOVA LINCS, Universidade NOVA de Lisboa
    Jamie Callan - Carnegie Mellon University

  • PDF file [CMUInformedia] CMU-Informedia at TREC 2019 Incident Streams Track
    Junpei Zhou, Xinyu Wang, Po-yao Huang, and Alexander Hauptmann - Carnegie Mellon University

  • PDF file [CS-UCD] Classification for Crisis-Related Tweets Leveraging Word Embeddings and Data Augmentation
    Congcong Wang and David Lillis - University College Dublin

  • PDF file [CSIROmed] CSIRO at 2019 TREC Precision Medicine Track
    Maciej Rybinski, Sarvnaz Karimi and Cecile Paris - CSIRO Data61

  • PDF file [DICE_UPB] Fine-tuned BERT Model for Multi-Label Tweets Classification
    Hamada M. Zahera - DICE, Paderborn University, Paderborn, Germany
    Ibrahim Elgendy - Harbin Institute of Technology, Harbin, China
    Rricha Jalota and Mohamed Ahmed Sherif - DICE, Paderborn, Germany

  • PDF file [DLR_DW] Classification of Incident-related Tweets: Exploiting Word and Sentence Embeddings
    Anna Kruspe, Jens Kersten and Friederike Klan - German Aerospace Center (DLR)

  • PDF file [DUTIR] Testing Fairness Using the Log-likelihood Ratio
    Massimo Melucci - University of Padua

  • PDF file [DUTIR] DUTIR at TREC 2019: Precision Medicine Track
    Jingkun Feng, Zhihao Yang, Zhiqiang Liu, Ling Luo, Hongfei Lin and Jian Wang - Dalian University of Technology

  • PDF file [ECNU_ICA] LINBER: A Retrieval-based Conversational Assistant using Entity Linking and BERT
    Yucheng Li, Yuxiang Sun, Jun Zhang, Pei Huo, Yan Yang and Liang He - East China Normal University

  • PDF file [ECNU_ICA] ECNU-ICA team at TREC 2019 Precision Medicine Track
    Qi Zheng, Yong Li, Jiaying Hu, Yan Yang and Liang He - East China Normal University
    Yi Xue - University of Nottingham Ningbo China

  • PDF file [h2oloo] H2oloo at TREC 2019: Combining Sentence and Document Evidence in the Deep Learning Track
    Zeynep Akkalyoncu Yilmaz, Shengjin Wang, and Jimmy Lin - University of Waterloo

  • PDF file [ICTNET] ICTNET at Trec 2019 Conversational Assistance Track
    Changying Hao, Yuanyuan Zhang, Weifeng Yang and Heng Zhao - Chinese Academy of Sciences

  • PDF file [ICTNET] ICTNET at TREC 2019 Complex Answer Retrieval Track
    Hongfei Ren, Ruibin Xiong, Yutao Zeng, Jiangui Chen, Yinqiong Cai and Haoquan Jiang - University of Chinese Academy of Sciences

  • PDF file [ICTNET] ICTNET at Trec 2019 Decision Track
    Wanqing Cui, Yan Jiang, Shuchang Tao and Hanzhang Guo - Chinese Academy of Sciences

  • PDF file [ICTNET] ICTNET at TREC 2019 Deep Learning Track
    Jiangui Chen, Yinqiong Cai and Haoquan Jiang - University of Chinese Academy of Sciences

  • PDF file [ICTNET] ICT at TREC 2019: Fair Ranking Track
    Meng Wang, Haopeng Zhang, Fuhuai Liang, Bin Feng and Di Zhao - Chinese Academy of Sciences

  • PDF file [ICTNET] ICTNET at Trec 2019 Incident Streams Track
    Kuang Guangsheng, Zhang Kun, Zhang Jiabao and Zheng Xin - University of Chinese Academy of Sciences

  • PDF file [ICTNET] ICTNET at TREC 2019 News Track
    Yuyang Ding, Xiaoying Lian, Houquan Zhou, Zhaoge Liu, Hanxing Ding and Zhongni Hou - University of Chinese Academy of Sciences

  • PDF file [IDST] IDST at TREC 2019 Deep Learning Track: Deep Cascade Ranking with Generation-based Document Expansion and Pre-trained Language Modeling
    Ming Yan, Chenliang Li, Chen Wu, Bin Bi, Wei Wang, Jiangnan Xia, and Luo Si - Alibaba Group

  • PDF file [IIT_BHU] IIT BHU at TREC 2019 Incident Streams Track
    Akanksha Mishra and Sukomal Pal - Indian Institute of Technology (BHU)

  • PDF file [imi_mug] TREC 2019 Precision Medicine - Medical University of Graz
    Pilar López-Úbeda - Universidad de Jaén
    José Antonio Vera-Ramos and Pablo López-García - Medical University of Graz

  • PDF file [ims_unipd] Exploring how to Combine Query Reformulations for Precision Medicine
    Giorgio Maria Di Nunzio, Stefano Marchesin and Maristella Agosti - University of Padua

  • PDF file [IR-Cologne] Fair ranking in academic search - Notebook for the TREC 2019 Fair Ranking Track
    Malte Bonart - Technische Hochschule Köln

  • PDF file [IRIT] IRIT at TREC 2019: Incident Streams and Complex Answer Retrieval Tracks
    Alexis Dusart, Gilles Hubert, and Karen Pinel-Sauvagnat - Universite de Toulouse UPS-IRIT

  • PDF file [julie-mug] JULIE Lab & Med Uni Graz @ TREC 2019 Precision Medicine Track
    Erik Faessler and Udo Hahn - Jena University Language and Information Engineering (JULIE) Lab
    Michel Oleynik - Medical University of Graz

  • PDF file [Microsoft] DUET AT TREC 2019 DEEP LEARNING TRACK
    Bhaskar Mitra and Nick Craswell - Microsoft

  • PDF file [mpi-inf-d5] CROWN: Conversational Passage Ranking by Reasoning over Word Networks
    Magdalena Kaiser, Rishiraj Saha Roy and Gerhard Weikum - Max Planck Institute for Informatics

  • PDF file [mpii] MPII at TREC CAsT 2019: Incoporating Query Context into a BERT Re-ranker
    Samarth Mehrotra - Technical University of Munich
    Andrew Yates - Max Planck Institute for Informatics

  • PDF file [OzUNLP] OzU-NLP at TREC NEWS 2019: Entity Ranking
    Kenan Fayoumi - Özyeğin University
    Reyyan Yeniterzi - Sabanci University

  • PDF file [Poznan] Poznan Contribution to TREC-PM 2019
    Artur Cieślewicz - Poznan University of Medical Sciences
    Jakub Dutkiewicz and Czesław Jędrzejek - Poznan University of Technology

  • PDF file [QU] bigIR at TREC 2019: Graph-based Analysis for News Background Linking
    Marwa Essam and Tamer Elsayed - Qatar University

  • PDF file [RUCIR] RUCIR at TREC 2019: Conversational Assistance Track
    Xiaochen Zuo, Xue Yang, Zhicheng Dou and Ji-Rong Wen - Renmin University of China

  • PDF file [RUIR] Radboud University at TREC 2019
    Chris Kamphuis, Faegheh Hasibi and Arjen P. de Vries - Radboud University
    Tanja Crijns - Alumna, Radboud University

  • PDF file [Smith] Smith at TREC2019: Learning to Rank Background Articles with Poetry Categories and Keyphrase Extraction
    John Foley, Ananda Montoly and Mayeline Pena - Smith College

  • PDF file [TREMA-UNH] TREMA-UNH at CAR 2019
    Jordan Ramsdell, Sumanta Kashyapi, Shubham Chatterjee, Pooja Oza and Laura Dietz - University of New Hampshire

  • PDF file [TU-Vienna] TU Wien @ TREC Deep Learning '19 -- Simple Contextualization for Re-ranking
    Sebastian Hofstätter, Markus Zlabinger and Allan Hanbury - TU Wien

  • PDF file [TUA1] TUA1 at the TREC 2019: Deep Learning Track
    Yun Gao, Xin Kang and Fuji Ren - Tokushima University
    Hai-Tao Yu - University of Tsukuba

  • PDF file [UAGPLSI] GPLSI at TREC 2019 Incident Streams Track
    Javi Fernández, Fernando Llopis, Patricio Martínez-Barco, and José M. Gómez - University of Alicante

  • PDF file [UAmsterdam] University of Amsterdam at the TREC 2019 Complex Answer Retrieval Track
    Mahsa S. Shahshahani, Jaap Kamps, and Maarten Marx - University of Amsterdam

  • PDF file [UCAS] UCAS at TREC-2019 Deep Learning Track
    Xuanang Chen, Canjia Li, Ben He, and Yingfei Sun - University of Chinese Academy of Sciences

  • PDF file [udel_fang] Exploring Query Reformulation for Conversational Information Seeking
    Disen Wang and Hui Fang - University of Delaware

  • PDF file [udel_fang] Higway BERT for Passage Ranking
    Di Zhao and Hui Fang - University of Delaware

  • PDF file [udel_fang] Leveraging Entities in Background Document Retrieval for News Articles
    Kuang Lu and Hui Fang - University of Delaware

  • PDF file [UMass] UMass at TREC 2019 Conversational Assistance Track
    Helia Hashemi and W. Bruce Croft - University of Massachusetts, Amherst

  • PDF file [UNC_SILS] UNC SILS at TREC 2019 News Track
    Jiaming Qu and Yue Wang - University of North Carolina at Chapel Hill

  • PDF file [UNC_SILS] UNC SILS at TREC 2019 Precision Medicine Track
    Jiaming Qu and Yue Wang - University of North Carolina at Chapel Hill

  • PDF file [UNIVAQ] Deep Learning Approach for the Precision Medicine Track
    Juan Pablo Consuegra-Ayala - University of Havana
    Giovanni Stilo, Alessandro Celi and Amleto Di Salle - University of L'Aquila

  • PDF file [uogTr] University of Glasgow Terrier Team and Naver Labs Europe at TREC 2019 Fair Ranking Track
    Graham McDonald, Iadh Ounis and Craig Macdonald - University of Glasgow
    Thibaut Thonet and Jean-Michel Renders - NAVER LABS Europe

  • PDF file [uogTr] University of Glasgow Terrier Team at the TREC 2019 Deep Learning Track
    Ting Su, Xi Wang, Craig Macdonald and Iadh Ounis - University of Glasgow

  • PDF file [UQ] UQ IElab at TREC 2019 Decision Track
    Jimmy - Australia University of Surabaya (UBAYA)
    Guido Zuccon - University of Queensland

  • PDF file [UQ] UQ at the TREC 2019 News Track
    Vu Anh Le and Gianluca Demartini - University of Queensland

  • PDF file [USI] Predicting Relevant Conversation Turns for Improved Retrieval in Multi-Turn Conversational Search
    Esteban A. Ríssola, Manajit Chakraborty, and Fabio Crestani - Universita della Svizzera italiana (USI)
    Mohammad Aliannejadi - University of Amsterdam

  • PDF file [UvA.ILPS] ILPS at TREC 2019 Conversational Assistant Track
    Nikos Voskarides, Dan Li, Andreas Panteli and Pengjie Ren - University of Amsterdam

  • PDF file [UWaterlooMDS] UWaterlooMDS at the TREC 2019 Decision Track
    Mustafa Abualsaud, Fuat C. Beylunioğlu, Mark D. Smucker, and P. Robert Duimering - University of Waterloo

  • PDF file [VES] VES Team at TREC Conversational Assistance Track (CAsT) 2019
    Vasileios Stamatis, Leif Azzopardi and Alan Wilson - University of Strathclyde

  • PDF file [WaterlooClarke] WaterlooClarke at the TREC 2019 Conversational Assistant Track
    Charles L. A. Clarke - University of Waterloo

  • PDF file [Webis] Webis at TREC 2019: Decision Track
    Alexander Bondarenko, Maik Frobe, Vaibhav Kasturia and Matthias Hagen - Martin-Luther-Universität Halle-Wittenberg
    Michael Völske and Benno Stein - Bauhaus-Universität Weimar

  • Appendix




    Last updated: Thursday, 29-Apr-2021 10:38:58 UTC
    Date created: February 21, 2020
    trec@nist.gov