TREC 2025 Proceedings
uema2lab_narrative
Submission Details
- Organization
- tus
- Track
- Retrieval-Augmented Generation
- Task
- Retrieval Only Task
- Date
- 2025-08-18
Run Description
- Is this a manual (human intervention) or automatic run?
- automatic
- Does this run leverage neural networks?
- yes
- Does this run leverage proprietary models in any step of the retrieval pipeline?
- yes
- Does this run leverage open-weight LLMs (> 5B parameters) in any step of the retrieval pipeline?
- no
- Does this run leverage smaller open-weight language models in any step of the retrieval pipeline?
- no
- Was this run padded with results from a baseline run?
- no
- What would you categorize this run as?
- Ensemble/Fusion of First Stages
- Please provide a short description of this run
- We applied a hybrid search combining BM25 and dense retrieval (OpenAI text-embedding-3-small, 1536-dim) to retrieve the top-20 documents per narrative. From each document, the segment most similar in embedding space to the narrative text was selected, and the ranked document lists were thus converted into segment-level lists for evaluation. This run serves as a comparison baseline to the subquery-expansion approach. The results are compared against other runs (runid: uema2lab_rrf, uema2lab_rrf_k10, uema2lab_segment).
- Please give this run a priority for inclusion in manual assessments.
- 4
Evaluation Files
Paper