TREC 2025 Proceedings
hybrid.stable.loose2
Submission Details
- Organization
- DUTH
- Track
- Retrieval-Augmented Generation
- Task
- Relevance Judgment subtask
- Date
- 2025-08-31
Run Description
- Is this a manual (human intervention) or automatic run?
- automatic
- Does this run leverage neural networks?
- yes
- Does this run leverage proprietary models in any step of the retrieval pipeline?
- no
- Does this run leverage open-weight LLMs (> 5B parameters) in any step of the retrieval pipeline?
- no
- Does this run leverage smaller open-weight language models in any step of the retrieval pipeline?
- yes
- What would you categorize this run as?
- Multi-Stage Pipeline pointwise
- Please provide a short description of this run
- Looser StableLM hybrid. Same blended confidence; calibration tuned for broader non-zero coverage (th1=0.30, th2=0.40, th3=0.56, th4=0.70; cap4=2, cap34=7; floor-2=3). Focus: high pool coverage with balanced 2/3/4.
- Please give this run a priority for inclusion in manual assessments.
- 4
Evaluation Files
Paper