TREC 2025 Proceedings
duth.hybrid.qwencon
Submission Details
- Organization
- DUTH
- Track
- Retrieval-Augmented Generation
- Task
- Relevance Judgment subtask
- Date
- 2025-08-31
Run Description
- Is this a manual (human intervention) or automatic run?
- automatic
- Does this run leverage neural networks?
- yes
- Does this run leverage proprietary models in any step of the retrieval pipeline?
- no
- Does this run leverage open-weight LLMs (> 5B parameters) in any step of the retrieval pipeline?
- no
- Does this run leverage smaller open-weight language models in any step of the retrieval pipeline?
- yes
- What would you categorize this run as?
- Multi-Stage Pipeline pointwise
- Please provide a short description of this run
- Conservative variant of the Qwen hybrid. Same pipeline; tighter calibration for high labels (th1=0.40, th2=0.54, th3=0.68, th4=0.80; cap4=1, cap34=4; topk4=1, topk3=4, topk2=8). Focus: higher precision for 3/4.
- Please give this run a priority for inclusion in manual assessments.
- 3
Evaluation Files
Paper