Text REtrieval Conference (TREC) 2021 Proceedings

NIST Special Publication: NIST SP 500-335 The Thirtieth Text REtrieval Conference (TREC 2021) Proceedings
TREC home Publications home Indexed by Track Help

NOTE: All papers are available in PDF format. The inclusion or omission of a particular company or product implies neither endorsement nor criticism by NIST. Any opinions, findings, and conclusions or recommendations expressed in the individual papers are the authors' own and do not necessarily reflect those of the sponsors.

Overview Papers [Overview_TREC] Overview of TREC 2021 Ian Soboroff - NIST [Overview_CAsT] TREC CAsT 2021: The Conversational Assistance Track Overview Jeffrey Dalton - University of Glasgow Chenyan Xiong - Microsoft Research Jamie Callan - Carnegie Mellon University [Overview_Deep_Learning] Overview of the TREC 2021 Deep Learning Track Nick Craswell and Bhaskar Mitra - Microsoft Emine Yilmaz - University College London Daniel Campos - University of Illinois Urbana-Champaign and Neural Magic Inc. Jimmy Lin - University of Waterloo [Overview_Fair_Ranking] Overview of the TREC 2021 Fair Ranking Track Michael D. Ekstrand and Amifa Raj - Boise State Graham McDonald - University of Glasgow Isaac Johnson - WIKIMEDIA [Overview_Health] Overview of the TREC 2021 Health Misinformation Track Charles L. A. Clarke, University of Waterloo Maria Maistro, University of Copenhagen Mark D. Smucker, University of Waterloo [Overview_Podcasts] TREC 2021 Podcasts Track Overview Jussi Karlgren, Rosie Jones, Ben Carterette, Ann Clifton and Edgar Tanaka - Spotify Maria Eskevich - CLARIN ERIC Gareth J. F. Jones - Dublin City University Sravana Reddy - ASAPP
Participant Papers [ALIBABA] Alibaba DAMO Academy at TREC Clinical Trials 2021: Exploring Embedding-based First-stage Retrieval with TrialMatcher Qiao Jin, Zhengyun Zhao, Zheng Yuan - Tsinghua University Qiao Jin, Chuanqi Tan, Zheng Yuan and Songfang Huang - Alibaba Inc. [BITEM] SIB Text Mining at TREC Clinical Trials 2021 Deborah Caucheteura, Emilie Pasche, Luc Mottin, Anais Mottaz, Julien Gobeill and Patrick Ruch - HES-SO / HEG Geneva, Information Sciences, Geneva, Switzerland Deborah Caucheteura, Emilie Pasche, Luc Mottin, Anais Mottaz, Julien Gobeill and Patrick Ruch - SIB Text Mining, Swiss Institute of Bioinformatics, Geneva, Switzerland Luc Mottin - Department of Microbiology and Molecular Medicine, Faculty of Medicine, University of Geneva, Geneva, Switzerland [CERTH_ITI_M4D] M4D-MKLab/ITI-CERTH Participation in TREC Deep Learning Track 2021 Alexandros-Michail Koufakis, Theodora Tsikrika, Stefanos Vrochidis and Ioannis Kompatsiaris - Information Technologies Institute, Centre for Research and Technology Hellas, Thermi-Thessaloniki, Greece [CFDA_CLIP] An Exploration Study of Multi-stage Conversational Passage Retrieval: Paraphrase Query Expansion and Multi-view Point-wise Ranking Jia-Huei Ju, Chih-Ting Yeh, Cheng-Wei Lin, Chia-Ying Tsao, Jun-En Ding and Chuan-Ju Wang - Research Center for Information Technology Innovation, Academia Sinica Ming-Feng Tsai - Department of Computer Science, National Chengchi University [CincyMedIR] CincyMedIR at TREC 2021 Clinical Trial Track Hoang Vu, MSI - Department of Biomedical Informatics, University of Cincinnati College of Medicine, Cincinnati, OH; Department of Electrical Engineering and Computer Science, College of Engineering and Applied Science Danny T.Y. Wu, PhD - University of Cincinnati, Cincinnati, OH [CIP] CIP at TREC 2021 Deep Learning Track Xuanang Chen, Ben He and Yingfei Sun - University of Chinese Academy of Sciences, Beijing, China Xuanang Chen, Ben He and Le Sun - Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences, Beijing, China [CiTIUS] CiTIUS at the TREC 2021 Health Misinformation Track Marcos Fernandez-Pichel, Manuel Prada-Corral, David E. Losada, Juan C. Pichel and Pablo Gamallo - Centro Singular de Investigacion en Tecnoloxías Intelixentes (CiTIUS), Universidade de Santiago de Compostela 15782 Santiago de Compostela, Spain [clinical_trials] An approach to relevant clinical trials retrieving Mariia Fedorova - ElmDoc B.V. [CMU-LTI] Query Rewriting with Expansion and Multi-Turn Entity Graphs for Answer Selection Nour Jedidi, Gustavo Goncalves and Jamie Callan - Language and Technology Institute, Carnegie Mellon University, USA Gustavo Goncalves - NOVA LINCS, Universidade NOVA de Lisboa, Portugal [CNR] Finding Context through Utterance Dependencies in Search Conversations - Participation of the CNR Team in CAsT 2021 Ida Mele - IASI-CNR, Rome, Italy Cristina Ioana Muntean, Franco Maria Nardini and Raffaele Perego - ISTI-CNR, Pisa, Italy Nicola Tonellotto - University of Pisa, Italy [CSIROmed] CSIROmed Team Report of TREC 2021 Clinical Trials track: Experiments with BERT Reranking Methods Maciej Rybinski, Vincent Nguyen and Sarvnaz Karimi - CSIRO Data61, Sydney, Australia [DigiLab] DS4DH at TREC Health Misinformation 2021: Multi-Dimensional Ranking Models with Transfer Learning and Rank Fusion Boya Zhang, Fernando Jaume-Santero and Douglas Teodoro - Department of Radiology and Medical Informatics, University of Geneva Nona Naderi and Douglas Teodoro - HES-SO University of Applied Sciences and Arts of Western Switzerland Swiss Institute of Bioinformatics Nona Naderi and Douglas Teodoro - Swiss Institute of Bioinformatics [DOSSIER] DOSSIER at TREC 2021 Clinical Trials Track Wojciech Kusa and Yasin Ghafourian - TU Wien, Vienna, Austria Yasin Ghafourian - Research Studios Austria, Vienna, Austria [FUH] University of Hagen @ TREC2021 News Track Stefan Wagenpfeil and Matthias Hemmje - Faculty of Mathematics and Computer Science, University of Hagen, Germany Paul Mc Kevitt - Academy for International Science & Research (AISR), Derry/Londonderry, Ireland [GU_BioMed] Clinical Trial Search Using Lucene and UMLS Yanqing Ji - Department of Electrical and Computer Engineering, Gonzaga University, Spokane, Washington, USA Yun Tian - Department of Computer Sci. and Electrical Eng., Eastern Washington University, Spokane WA, USA Hao Ying - Department of Electrical and Computer Engineering, Wayne State University, Detroit, Michigan, USA John Tran - Department of Psychiatry, University of California San Francisco at Fresno, Fresno, California, USA [IBMResearch] IBM @ TREC Clinical Trials Track 2021 Laura Biester - Computer Science & Engineering, University of Michigan Venkata Joopudi and Bharath Dandala - IBM Research [IHSM] QUALITY AND COST TRADE-OFFS IN PASSAGE RE-RANKING TASK Pavel Podberezko, Vsevolod Mitskevich, Raman Makouski, Pavel Goncharov, Andrei Khobnia, Nikolai Bushkov and Marina Chernyshevich - IHS Markit [IITD-DBAI] IITD-DBAI: Multi-Stage Retrieval with Pseudo-Relevance Feedback and Query Reformulation Shivani Choudhary - Indian Institute of Technology, Delhi [ims_unipd] Filter, Transform, Expand, and Fuse The IMS Unipd at TREC 2021 Clinical Trials Giorgio Maria Di Nunzio, Guglielmo Faggioli and Stefano Marchesin - Department of Information Engineering, University of Padua, Italy [IR-Cologne] IRCologne at TREC 2021 News Track Relation-based re-ranking for background linking BJORN ENGELMANN and PHILIPP SCHAER - TH Koln (University of Applied Sciences), Germany [IRlab-Amsterdam] IRLab-Amsterdam at TREC 2021 Conversational Assistant Track Antonios Minas Krasakis and Evangelos Kanoulas - University of Amsterdam, The Netherlands [IRlab-Amsterdam] The University of Amsterdam at the TREC 2021 Fair Ranking Track Ali Vardasbi, Gabriel Bénédict, Shashank Gupta, Maria Heuss, Pooya Khandel, Ming Li and Fatemeh Sarvi - University of Amsterdam, The Netherlands [IRUniDUE] TREC 2021⋆ Clinical Trials Retrieval, Duisburg-Essen University submission Sameh Frihat and Norbert Fuhr - University of Duisburg-Essen, Duisburg, Germany [ITTC-AIMedTech] ITTC @ TREC 2021 Clinical Trials Track Hung-Thinh Truong, Yulia Otmakhova, Timothy Baldwin, Jey Han Lau, Trevor Cohn and Karin Verspoor - The University of Melbourne Rahmad Mahendra, Karin Verspoor, Lawrence Cavedon, Damiano Spina and Karin Verspoor - RMIT University [L3i_Rochelle] Transformer-based Methods with #Entities for Detecting Emergency Events on Social Media Emanuela Boros, Nhu Khoa Nguyen, Mickael Coustaty and Antoine Doucet - University of La Rochelle, L3i, La Rochelle, France Gael Lejeune - Sorbonne University, STIH/CERES, Paris, France [L3i_Rochelle] Elastic Embedded Background Linking for News Articles with Keywords, Entities and Events Luis Adrian Cabrera-Diego, Emanuela Boros and Antoine Doucet - University of La Rochelle, L3i, La Rochelle, France [L3S] L3S at the TREC 2021 Deep Learning Track Jurek Leonhardt and Avishek Anand - L3S Research Center,Hannover, Germany Koustav Rudra - Indian Institute of Technology (ISM) Dhanbad, India [middlebury] Middlebury at TREC News ’21 Exploring Learning to Rank Model Variants Culton Koster and John Foley - Department of Computer Science, Middlebury College, Middlebury, VT [MLIA-LIP6] MLIA-LIP6@TREC-CAST2021: Feature augmentation for query recontextualization and passage ranking Nawel Astaouti, Thomas Gerald, Maya Touzari and Laure Soulier - CNRS-ISIR, Sorbonne University, Paris, France Jian-Yun Nie - University of Montreal, Montreal, Canada [njit] Method Comparison for Crisis Pipelines Shivam Sharma and Cody Buntain - New Jersey Institute of Technology [NLE] NAVER LABS EUROPE (SPLADE) @ TREC DEEP LEARNING 2021 Carlos Lassance, Arnaud Sors and Stephane Clinchant - Naver Labs Europe, France Thibault Formal - Naver Labs Europe and Sorbonne Universite, ISIR, France Benjamin Piwowarski - Sorbonne Universite, ISIR, CNRS, France [NTU_NLP] Hybrid Re-ranking for Biomedical Information Retrieval at the TREC 2021 Clinical Trials Track Ming-Xuan Shi, Tsung-Hsuan Pan and Hsin-Hsi Chen - Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan Hen-Hsen Huang - Institute of Information Science, Academia Sinica, Taipei, Taiwan [PASH] PASH at TREC 2021 Deep Learning Track: Generative Enhanced Model for Multi-stage Rankingtrack: DL Yixuan Qiao, Hao Chen, Jun Wang, Peng Gao, and Guotong Xie - Ping An Health Technology, Beijing, China Tuozhen Liu - Central University of Finance and Economics, Beijing, China Xianbin Ye - Jinan University, Guangzhou, China Guotong Xie - Ping An Health Cloud Company Limited., Shenzhen, China and Ping An International Smart City Technology Co., Ltd., Shenzhen, China [PoliTO] PoliTO at TREC 2021 Podcast Summarization Track Lorenzo Vaiani, Moreno La Quatra, Luca Cagliero and Paolo Garza - Dipartimento di Automatica e Informatica Politecnico di Torino, Italy [POZNAN] Pozna´n Contribution to TREC Clinical Trials 2021⋆ Jakub Dutkiewicz and Czeslaw Jedrzejek - Faculty of Computing, Poznan University of Technology, Poznan, Poland [QU] bigIR at TREC 2021: Adopting Transfer Learning for News Background Linking Marwa Essam and Tamer Elsayed - Computer Science and Engineering Department, Qatar University, Doha, Qatar [RMIT-IR] RMIT at TREC 2021 Fair Ranking Track SACHIN PATHIYAN CHERUMANAL, DAMIANO SPINA and FALK SCHOLER - RMIT University, Australia W. BRUCE CROFT - University of Massachusetts Amherst, USA [RUIR] Radboud University at TREC CAsT 2021 Hideaki Joko, Emma J. Gerritse, Faegheh Hasibi, and Arjen P. de Vries - Radboud University, Nijmegen, The Netherlands [SienaCLTeam] Siena’s Incident Stream System SISS Ting Liu, Sharon Gower Small, Patrick Baumgardner, Lydia Cartwright, Michael Coppola and Samuil Orlioglu - Siena College Institute for Artificial Intelligence, Loudonville, NY [SU-NLP] SU-NLP at TREC NEWS 2021 Kenan Fayoumi and Reyyan Yeniterzi - Sabancı University, Istanbul, Turkey [TDMINER] The Application of Traditional IE as a Non-traditional Method in an IR Task: TDMINER at 2021 TREC Clinical Trials Chengyi Zheng - Kaiser Permanente Southern California, Pasadena, CA [TKB48] TKB48 at TREC 2021 Conversational Assistance Track Yubo Fang - Graduate School of Comprehensive Human Sciences, University of Tsukuba, Ibaraki, Japan Hideo Joho - Faculty of Library, Information and Media Science, University of Tsukuba, Ibaraki, Japan Sumio Fujita - Yahoo Japan Corporation, Tokyo, Japan [TKB48] TKB48 at TREC 2021 Fairness Ranking Track Jin Zhuoqi - Graduate School of Comprehensive Human Sciences, University of Tsukuba, Ibaraki, Japan Hideo Joho - Faculty of Library, Information and Media Science, University of Tsukuba, Ibaraki, Japan Sumio Fujita - Yahoo Japan Corporation, Tokyo, Japan [TKB48] TKB48 at TREC 2021 News Track Zhang Lirong - Graduate School of Comprehensive Human Sciences, University of Tsukuba, Ibaraki, Japan Hideo Joho - Faculty of Library, Information and Media Science, University of Tsukuba, Ibaraki, Japan Sumio Fujita - Yahoo Japan Corporation, Tokyo, Japan [TU_Vienna] TU Wien at TREC DL and Podcast 2021: Simple Compression for Dense Retrieval Sebastian Hofstatter, Mete Sertkan and Allan Hanbury - TU Wien [UAmsterdam] Recall Aspects of Transformers for Text Ranking David Rau and Jaap Kamps - University of Amsterdam [UCD-CS] UCD-CS at TREC 2021 Incident Streams Track Congcong Wang and David Lillis - School of Computer Science, University College Dublin, Ireland [UiS] The University of Stavanger (IAI) at the TREC 2021 Conversational Assistance Track Ivica Kostric, Krisztian Balog, Magnus Book, Trond Linjordet, and Vinay Setty - University of Stavanger, Norway [UMD] Full-Collection Search with Passage and Document Evidence: Maryland at the TREC 2021 Conversational Assistance Track Xin Qian and Douglas W. Oard - University of Maryland, College Park [uni_pais_vasco] TREC 2021 Clinical Trials Submission for Universidad del País Vasco Jordan Koontz - Ixa (UPV/EHU) Maite Oronoz and Alicia Pérez - HiTZ (UPV/EHU) [Unicamp] Multilingual Podcast Summarization using Longformers Edgar Tanaka, Ann Clifton and Md. Iftekhar Tanveer - Spotify [UNIMIB] UNIMIB at TREC 2021 Clinical Trials Track Georgios Peikos, Oscar Espitia, and Gabriella Pasi - Information and Knowledge Representation, Retrieval, and Reasoning (IKR3) Lab, Department of Informatics, Systems, and Communication (DISCo), University of Milano-Bicocca, Milan, Italy [UNTIIA] UNTIIA Lab at TREC 2021 - Clinical Trial* Huyen Nguyen, Haihua Chen, Bhanu Prasad and Junhua Ding - Intelligent Information Access Laboratory, University of North Texas Huyen Nguyen, Haihua Chen, Bhanu Prasad, Junhua Ding, Jiangping Chen and Ana Cleveland - Department of Information Science, University of North Texas Huanhuan Zhao - Department of Bioinformatics, University of Texas at El Paso [uogTr] University of Glasgow Terrier Team (uogTr) at the TREC 2021 Incident Streams Track Xiao Wang, Sean MacAvaney, Craig Macdonald and Iadh Ounis - University of Glasgow, UK Thomas Jaenich, Graham McDonald and Iadh Ounis - University of Glasgow, UK Alexander J. Hepburn and Richard McCreadie - University of Glasgow, UK [uogTr] University of Glasgow Terrier Team (uogTr) at the TREC 2021 Incident Streams Track Xiao Wang, Sean MacAvaney, Craig Macdonald and Iadh Ounis - University of Glasgow, UK Thomas Jaenich, Graham McDonald and Iadh Ounis - University of Glasgow, UK Alexander J. Hepburn and Richard McCreadie - University of Glasgow, UK [uogTr] University of Glasgow Terrier Team (uogTr) at the TREC 2021 Incident Streams Track Xiao Wang, Sean MacAvaney, Craig Macdonald and Iadh Ounis - University of Glasgow, UK Thomas Jaenich, Graham McDonald and Iadh Ounis - University of Glasgow, UK Alexander J. Hepburn and Richard McCreadie - University of Glasgow, UK [UPV] UPV at TREC Health Misinformation Track 2021 Ranking with SBERT and Quality Estimators Ipek Baris Schlicht, Angel Felipe Magnossao de Paula and Paolo Rosso - Universitat Politecnica de Valencia, Spain [UwaterlooMDS] UWaterlooMDS at the TREC 2021 Health Misinformation Track MUSTAFA ABUALSAUD, KAMYAR GHAJAR, LINH NHI PHAN MINH and DAKE ZHANG - David R. Cheriton School of Computer Science, University of Waterloo IRENE XIANGYI CHEN - Department of Electrical and Computer Engineering, University of Waterloo MARK D. SMUCKER and AMIR VAKILI TAHAMI - Department of Management Sciences, University of Waterloo [Waterloo_Cormack] Semantic Search for Background Linking in News Articles Udhav Sethi and Anup Anand Deshmukh - University of Waterloo [WaterlooClarke] WaterlooClarke at the TREC 2021 Conversational Assistant Track Xinyi Yan, Charles L. A. Clarke and Negar Arabzadeh - [Webis] Webis at TREC 2021: Deep Learning, Health Misinformation, and Podcasts Tracks Alexander Bondarenko, Maik Frobe, Sebastian Gunther and Matthias Hagen - Martin-Luther-Universitat Halle-Wittenberg Marcel Gohsen, Johannes Kiesel, Michael Volske and Benno Stein - Bauhaus-Universitat Weimar Jakob Schwerter, Shahbaz Syed and Martin Potthast - Leipzig University [wispermedtxt] WisPerMed Text at TREC Clinical Trials Track 2021 Henning Schafer - Institute for Transfusion Medicine, University Hospital Essen, Germany Ahmad Idrissi-Yaghir and Christoph M. Friedrich - Department of Computer Science, University of Applied Sciences and Arts Dortmund (FHDO), Dortmund, Germany Wolfgang Galetzka and Christoph M. Friedrich - Institute of Medical Informatics, Biometry and Epidemiology (IMIBE), University Hospital Essen, Germany Marie Bexte - Language Technology Lab, University of Duisburg-Essen, Duisburg, Germany [yorku] York University at TREC 2021: Deep Learning Track Yizheng Huang and Jimmy Huang - Information Retrieval and Knowledge Management Research Lab, York University, Toronto, Canada Appendix Clinical Trials Track Runs Clinical Trials Track Results Conversational Assistance Track Runs Conversational Assistance Track Results Deep Learning Track Document Ranking Task Runs Deep Learning Track Passage Ranking Task Runs Deep Learning Track Document Retrieval Task Results Deep Learning Track Passage Retrieval Task Results Fair Ranking Track Runs Fair Ranking Track Results Health Misinformation Track Runs Health Misinformation Track Results Incident Streams Runs Incident Streams Results News Track Runs News Track Background Linking Task Results News Track Background Linking Task Subtopics Subtask Results News Track Wikification Task Results Podcast Track Segment Retrieval Task Runs Podcast Track Summarization Task Runs Podcast Track Segment Retrieval Task Results Podcast Track Summarization Task Results
Last updated: Tuesday, 07-Jun-2022 12:00:49 EDT Date created: March 22, 2022 trec@nist.gov