TREC 2025 Proceedings

hybrid.stable.loose2

Submission Details

Organization
DUTH
Track
Retrieval-Augmented Generation
Task
Relevance Judgment subtask
Date
2025-08-31

Run Description

Is this a manual (human intervention) or automatic run?
automatic
Does this run leverage neural networks?
yes
Does this run leverage proprietary models in any step of the retrieval pipeline?
no
Does this run leverage open-weight LLMs (> 5B parameters) in any step of the retrieval pipeline?
no
Does this run leverage smaller open-weight language models in any step of the retrieval pipeline?
yes
What would you categorize this run as?
Multi-Stage Pipeline pointwise
Please provide a short description of this run
Looser StableLM hybrid. Same blended confidence; calibration tuned for broader non-zero coverage (th1=0.30, th2=0.40, th3=0.56, th4=0.70; cap4=2, cap34=7; floor-2=3). Focus: high pool coverage with balanced 2/3/4.
Please give this run a priority for inclusion in manual assessments.
4

Evaluation Files

Paper