TREC 2025 Proceedings
gpt_5-sub-narr
Submission Details
- Organization
- coordinators
- Track
- Retrieval-Augmented Generation
- Task
- Relevance Judgment subtask
- Date
- 2025-09-10
Run Description
- Is this a manual (human intervention) or automatic run?
- automatic
- Does this run leverage neural networks?
- yes
- Does this run leverage proprietary models in any step of the retrieval pipeline?
- yes
- Does this run leverage open-weight LLMs (> 5B parameters) in any step of the retrieval pipeline?
- no
- Does this run leverage smaller open-weight language models in any step of the retrieval pipeline?
- no
- What would you categorize this run as?
- Multi-Stage Pipeline pointwise
- Please provide a short description of this run
- Creates sub-narratives from the narratives (GPT5) -> Uses the list of sub-narratives to allocate relevance labels (GPT5)
- Please give this run a priority for inclusion in manual assessments.
- 1 (top)
Evaluation Files