ensemble_umbrela1 — Relevance Judgment subtask

Is this a manual (human intervention) or automatic run?: automatic
Does this run leverage neural networks?: yes
Does this run leverage proprietary models in any step of the retrieval pipeline?: yes
Does this run leverage open-weight LLMs (> 5B parameters) in any step of the retrieval pipeline?: yes
Does this run leverage smaller open-weight language models in any step of the retrieval pipeline?: no
What would you categorize this run as?: Ensemble/Fusion of First Stages
Please provide a short description of this run: Majority voting over various qrels using UMBRELA variant
Please give this run a priority for inclusion in manual assessments.: 1 (top)