TREC 2025 Proceedings

gpt-oss-120b-high

Submission Details

Organization
coordinators
Track
Retrieval-Augmented Generation
Task
Relevance Judgment subtask
Date
2025-09-11

Run Description

Is this a manual (human intervention) or automatic run?
automatic
Does this run leverage neural networks?
yes
Does this run leverage proprietary models in any step of the retrieval pipeline?
no
Does this run leverage open-weight LLMs (> 5B parameters) in any step of the retrieval pipeline?
yes
Does this run leverage smaller open-weight language models in any step of the retrieval pipeline?
no
What would you categorize this run as?
Multi-Stage Pipeline pointwise
Please provide a short description of this run
Uses UMBRELA variant with gpt-oss-12b high reasoning
Please give this run a priority for inclusion in manual assessments.
2

Evaluation Files