TREC 2025 Proceedings

cru-most_common

Submission Details

Organization
HLTCOE
Track
Detection, Retr., and Gen for Understanding News
Task
Question Generation Task
Date
2025-08-20

Run Description

Is this run manual or automatic?
automatic
Is this run based on the provided starter kit?
no
Briefly describe this run
Prompt-based extraction of nuggets from source article. We use crucible's standard nugget extractor "most_common". The questions are probably more boring, but the gold answers can be matched to other source documents for report generation.
What other datasets or services (e.g. Google/Bing web search, ChatGPT, Perplexity, etc.) were used in producing the run?
Llama-3.3-70B Instruct (70B)
Briefly describe LLMs used for this run (optional)
Llama-3.3-70B Instruct (70B)
Please give this run a priority for inclusion in manual assessments.
2

Evaluation Files

Paper