TREC 2025 Proceedings
disco-qrecc-norerank
Submission Details
- Organization
- uva
- Track
- Interactive Knowledge Acquisition Track
- Task
- Passage Ranking and Response Generation
- Date
- 2025-07-27
Run Description
- What type of manually annotated information does the system use?
- automatic: system does not use any manually annotated data and relies only on the user utterance and system responses (canonical responses of previous turns)
- How is conversation understanding (NLP/rewriting) performed in this run (check all that apply)?
- ['method uses other query understanding method (please describe below)']
- What data is used for conversational query understanding in this run (check all that apply)?
- ['method uses other external data (please specify in the external resources field below)']
- How is ranking performed in this run (check all that apply)?
- ['method uses other ranking method (please describe below)']
- What data is used to develop the ranking method in this run (check all that apply)?
- ['method is trained on other datasets (please describe below)']
- Please specify all the methods used to handle feedback or clarification responses from the user (check all that apply).
- ['method does not treat them specially']
- Please describe the method used to generate the final conversational responses from one or more retrieved passages (check all that apply).
- ['method uses other approaches (please specify in description below)']
- Please describe how you integrate the PTKBs in your run (check all that apply)
- [' method uses other appraoches (please specify in description below)']
- Which LLM did you use to generate the final response?
- ['method uses closed-source commercial LLMs (e.g. GPT-*)']
- Please describe the external resources used by this run, if applicable.
- none
- Please provide a short description of this run.
- use disco splade-disco-human-mistral from huggingface
splade++
no rerank
generation nugget-based gpt41
- Please provide a priority for assessing this run. (If resources do not allow all runs to be assessed, NIST will work in priority order, resolving ties arbitrarily).
- 1 (top)
Evaluation Files
Paper