TREC 2025 Proceedings
cru-most_common
Submission Details
- Organization
- HLTCOE
- Track
- Detection, Retr., and Gen for Understanding News
- Task
- Question Generation Task
- Date
- 2025-08-20
Run Description
- Is this run manual or automatic?
- automatic
- Is this run based on the provided starter kit?
- no
- Briefly describe this run
- Prompt-based extraction of nuggets from source article.
We use crucible's standard nugget extractor "most_common". The questions are probably more boring, but the gold answers can be matched to other source documents for report generation.
- What other datasets or services (e.g. Google/Bing web search, ChatGPT, Perplexity, etc.) were used in producing the run?
- Llama-3.3-70B Instruct (70B)
- Briefly describe LLMs used for this run (optional)
- Llama-3.3-70B Instruct (70B)
- Please give this run a priority for inclusion in manual assessments.
- 2
Evaluation Files
Paper