The Thirty-Second Text REtrieval Conference
(TREC 2023)

Conference Proceedings

Overviews

Overview of TREC 2023 (coming soon)
Ian Soboroff, NIST

TREC2023 AToMiC Overview
Jheng-Hong Yang, University of Waterloo
Carlos Lassance, Naver Labs Europe
Rafael Sampaio de Rezende, Naver Labs Europe
Krishna Srinivasan, Google Research
Miriam Redi, Wikimedia Foundation
Stéphane Clinchant, Naver Labs Europe
Jimmy Lin, University of Waterloo

CrisisFACTS 2023 - Overview Paper
Cody Buntain, University of Maryland
Amanda Hughes, Brigham Young University
Richard McCreadie, University of Glasgow
Benjamin D. Horne, University of Tennessee
Muhammad Imran, Qatar Computing Research Institute
Hemant Purohit, George Mason University

Overview of the TREC 2023 Deep Learning Track
Nick Craswell, Microsoft
Bhaskar Mitra, Microsoft
Emine Yilmaz, University College London and Amazon
Hossein A. Rahmani, University College London
Daniel Campos, Snowflake
Jimmy Lin, University of Waterloo
Ellen M. Voorhees, NIST
Ian Soboroff, NIST

TREC iKAT 2023: The Interactive Knowledge Assistance Track Overview
Mohammad Aliannejadi, University of Amsterdam
Zahra Abbasiantaeb, University of Amsterdam
Shubham Chatterjee, University of Edinburgh
Jeffery Dalton, University of Edinburgh
Leif Azzopardi, University of Strathclyde

Overview of the TREC 2023 NeuCLIR Track
Dawn Lawrie, Johns Hopkins University Human Language Technology Center of Excellence
Sean MacAvaney, University of Glasgow
James Mayfield, Johns Hopkins University Human Language Technology Center of Excellence
Paul McNamee, Johns Hopkins University Human Language Technology Center of Excellence
Douglas W. Oard, University of Maryland
Luca Soldaini, Allen Institute for AI
Eugene Yang, Johns Hopkins University Human Language Technology Center of Excellence

Overview of the TREC 2023 Tip-of-the-Tongue Track
Jaime Arguello, University of North Carolina
Samarth Bhargav, University of Amsterdam
Fernando Diaz, Carnegie Mellon University
Evangelos Kanoulas, University of Amsterdam
Bhaskar Mitra, Microsoft Research

Participant Papers

[CFDA_CLIP] CFDA & CLIP Labs at TREC'23 Product Search Track
Jia-Huei Ju, Academia Sinica
Chung-Kang Lo, Academia Sinica
Yao-Cheng Lu, Academia Sinica
Kuan-Lin Lai, Academia Sinica
Cheng-Wei Huang, Academia Sinica
Wei-Hsin Chiu, Academia Sinica
Ming-Feng Tsai, National Chengchi University
Chuan-Ju Wang, Academia Sinica

[CIIR] UMass at TREC 2023 NeuCLIR Track
Zhiqi Huang, University of Massachusetts Amherst
Puxuan Yu, University of Massachusetts Amherst
James Allan, University of Massachusetts Amherst

[CIP] CIP at TREC Deep Learning Track 2023
Xiaoyang Chen, Chinese Information Processing Laboratory
Ben He, University of Chinese Academy of Sciences
Le Sun, Chinese Information Processing Laboratory
Yingfei Sun, University of Chinese Academy of Sciences

[CMU-LTI] Team CMU-LTI at TREC 2023 Tip-of-the-Tongue Track
Luís Borges, IST and INESC-ID, University of Lisbon, Portugal
Jamie Callan, Carnegie Mellon University, USA
Bruno Martins, IST and INESC-ID, University of Lisbon, Portugal

[CSIRO-UQ-ielab] Team IELAB at TREC Clinical Trial Track 2023: Enhancing Clinical Trial Retrieval with Neural Rankers and Large Language Models
Shengyao Zhuang, CSIRO
Bevan Koopman, CSIRO
Guido Zuccon, The University of Queensland

[CSIROmed] Matching of Patient Questionnaires to Clinical Trials with Large Language Models
Maciej Rybinski, CSIRO
Sarvnaz Karimi, CSIRO

[DoSSIER] DoSSIER at TREC 2023 Clinical Trials Track
Wojciech Kusa, TU Wien
Patrick Styll, TU Wien
Maximilian Seeliger, TU Wien
Oscar E. Mendoza, University of Milano-Bicocca
Allan Hanbury, TU Wien

[EMA3] MALNIS and EMA3 @ TREC 2023 Clinical Trials Track
Mozhgan Saeidi, Department of Computer Science, Dalhousie University, University Health Network(UHN)
Aman Jaiswal, Department of Computer Science, Dalhousie University
Abhishek Dhankar, Manitoba Centre for Health Policy, University of Manitoba
Alan Katz, Manitoba Centre for Health Policy, University of Manitoba
Evangelos Milios, Department of Computer Science, Dalhousie University

[Human_Info_Lab] Summarizing Social Media & News Streams for Crisis-related Events by Integrated Content-Graph Analysis: TREC-2023 CrisisFACTS Track
Hossein Salemi, George Mason University
Yasas Senarath, George Mason University
Tarin Sultata Sharika, George Mason University
Anuridhi Gupta, George Mason University
Hemant Purohit, George Mason University

[IDACCS] Fast Extractive Summarization, Abstractive Summarization, and Hybrid Summarization for CrisisFACTS at TREC 2023
Violet Burbank, Department of Defense
John M. Conroy, IDA Center for Computing Sciences
Sean Lynch, Department of Defense
Neil P. Molino, IDA Center for Computing Sciences
Julia S. Yang, Department of Defense

[IITD] Information Retrieval Combined with Large Language Model: Summarization Perspective
Shivani Choudhary, IITD
Niladri Chatterjee, IITD
Subir Kumar Saha, IITD

[IRLAB_IIT_BHU] Facts Summarization at the TREC 2023: IIT(BHU) in CrisisFACTs Track
Amit Yadav, Indian Institute of Technology(BHU) Varanasi Uttar Pradesh, India 221005
Sukomal Pal, Indian Institute of Technology(BHU) Varanasi Uttar Pradesh, India 221005

[IRLab-Amsterdam] LLM-based Retrieval and Generation Pipelines for TREC Interactive Knowledge Assistance Track (iKAT) 2023
Zahra Abbasiantaeb, University of Amsterdam
Chuan Meng, University of Amsterdam
David Rau, University of Amsterdam
Antonis Krasakis, University of Amsterdam
Hossein A. Rahmani, University College London
Mohammad Aliannejadi, University of Amsterdam

[ISI_SEARCHER] ISI's SEARCHER II System for TREC's 2023 NeuCLIR Track
Scott Miller, USC ISI
Shantanu Agarwal, USC ISI
Joel Barry, USC ISI

[InfoSense] Sequencing Matters: A Generate-Retrieve-Generate Model for Building Conversational Agents
Quinn Patwardhan, Sidwell Friends School
Grace Hui Yang, Georgetown University

[MU_CS] Leveraging OpenAI's Ada Embedding Model for Zero-Shot Classification at TREC 2023 Clinical Trials
Luke Richmond, Marquette University
Priya Deshpande, Marquette University

[NM] Large Language Models in Summarizing Social Media for Emergency Management
Jayr Pereira, NeuralMind
Rodrigo Nogueira, NeuralMind
Roberto Lotufo, NeuralMind

[OHM] Multi-Query Focused Disaster Summarization via Instruction-Based Prompting
Philipp Seeberger, Technische Hochschule Nürnberg Georg Simon Ohm
Korbinian Riedhammer, Technische Hochschule Nürnberg Georg Simon Ohm

[RALI] RALI@TREC iKAT 2023: Generative Query Reformulation for Conversational Information Seeking
Fengran Mo, University of Montreal
Bole Yi, University of Montreal
Jian-Yun Nie, University of Montreal

[RSLTOT] RSLTOT at the TREC 2023 ToT Track
Reo Yoshikoshi, Waseda University
Tetsuya Sakai, Waseda University

[SienaCLTeam] Query Expansion for Crisis Events
Jack Cheverton, Siena College
Sharon G. Small, Siena College
Ting Liu, Siena College

[TREMA-UNH] Exploring Topic Landscape for Question-Answering Models in Hyperbolic Embedding Space
Sumanta Kashyapi, University of New Hampshire
Laura Dietz, University of New Hampshire

[UAmsterdam] Multimodal Learned Sparse Retrieval for Image Suggestion Task
Thong Nguyen, University of Amsterdam
Mariya Hendriksen, University of Amsterdam
Andrew Yates, University of Amsterdam

[UNIMIB_IKR3] UNIMIB at TREC 2023 Clinical Trials Track
Georgios Peikos, University of Milano-Bicocca

[UWaterlooMDS] UWaterlooMDS at TREC 2023: Deep Learning Track and Tip-of-the-Tongue Track
Dake Zhang, University of Waterloo

[V-TorontoMU] TMU at TREC Clinical Trials Track 2023
Aritra Kumar Lahiri, Toronto Metropolitan University
Emrul Hasan, Toronto Metropolitan University
Qinmin Vivian Hu, Toronto Metropolitan University
Cherie Ding, Toronto Metropolitan University

[Webis] Webis at TREC 2023: Tip-of-the-Tongue track
Maik Fröbe, Friedrich-Schiller-Universität Jena
Christine Brychcy, Friedrich-Schiller-Universität Jena
Elisa Kluge, Friedrich-Schiller-Universität Jena
Eric Oliver Schmidt, Martin-Luther-Universität Halle-Wittenberg
Matthias Hagen, Friedrich-Schiller-Universität Jena

[endicott-unc] TREC-ToT: Endicott and UNC Notebook Paper
Henry Feild, Endicott College
Jaime Arguello, University of North Carolina at Chapel Hill

[h2oloo] TREC 2023 - h2oloo in the Product Search Challenge
Jheng-Hong Yang, University of Waterloo
Jimmy Lin, University of Waterloo

[h2oloo] Naverloo @ TREC Deep Learning and Neuclir 2023: As Easy as Zero, One, Two, Three � Cascading Dual Encoders, Mono, Duo, and Listo for Ad-Hoc Retrieval
Carlos Lassance, Naver Labs Europe
Ronak Pradeep, University of Waterloo
Jimmy Lin, University of Waterloo

[hltcoe] HLTCOE at TREC 2023 NeuCLIR Track
Eugene Yang, Human Language Technology Center of Excellence, Johns Hopkins University
Dawn Lawrie, Human Language Technology Center of Excellence, Johns Hopkins University
James Mayfield, Human Language Technology Center of Excellence, Johns Hopkins University

[jbnu] JBNU at TREC 2023 Product Search Track
Gi-taek An, Jeonbuk National University
Woo-Seok Choi, Jeonbuk National University
Jun-Yong Park, Jeonbuk National University
Kyung-Soon Lee, Jeonbuk National University

[nut-kslab] nut-kslab at TREC 2023 CrisisFACTS track
Phichamon Theamtun, Nagaoka University of Technology
Takashi YUKAWA, Nagaoka University of Technology

[snuldilab] SNU LDILAB @ TREC Tip of the tongue 2023
Jongho Kim, Seoul National University
Soona Hong, Seoul National University
Seung-won Hwang, Seoul National University

[trackorg] OVERVIEW OF THE TREC 2023 PRODUCT PRODUCT SEARCH TRACK
Daniel Campos, Snowflake
Surya Kallumadi, Lowes
Corby Rosset, Microsoft Research
Cheng Xiang Zhai, University of Illinois
Alessandro Magnani, Walmart

[ufmg] UFMG at the TREC 2023 Tip of the Tongue Track
Rita Borges de Lima, Universidade Federal de Minas Gerais
Rodrygo L. T. Santos, Universidade Federal de Minas Gerais

[umd_hcil] BLADE: The University of Maryland at the TREC 2023 NeuCLIR Track
Suraj Nair, University of Maryland
Douglas W. Oard, University of Maryland

[uogTr] Generative Relevance Feedback and Convergence of Adaptive Re-Ranking: University of Glasgow Terrier Team at TREC DL 2023
Andrew Parry, University of Glasgow
Thomas Jänich, University of Glasgow
Sean MacAvaney, University of Glasgow
Iadh Ounis, University of Glasgow

[uot-yahoo] University of Tsukuba Team at the TREC 2023 Interactive Knowledge Assistance Track
Lingzhen Zheng, Graduate School of Comprehensive Human Sciences, University of Tsukuba
Kaiyu Yang, Graduate School of Comprehensive Human Sciences, University of Tsukuba
Haitao Yu, Institute of Library, Information and Media Science, University of Tsukuba
Sumio Fujita, LY Research, LY Corporation
Hideo Joho, Institute of Library, Information and Media Science, University of Tsukuba

[uot-yahoo] University of Tsukuba Team at the TREC 2023 Deep Learning Track
Kaiyu Yang, Graduate School of Comprehensive Human Sciences, University of Tsukuba
Lingzhen Zheng, Graduate School of Comprehensive Human Sciences, University of Tsukuba
Haitao Yu, Institute of Library, Information and Media Science, University of Tsukuba
Sumio Fujita, LY Research, LY Corporation
Hideo Joho, Institute of Library, Information and Media Science, University of Tsukuba

Appendices

Deep Learning
Passage Retrieval Appendix
Document Retrieval Appendix