TREC 2025 Proceedings

cru-claude-chatty

Submission Details

Organization
HLTCOE
Track
Detection, Retr., and Gen for Understanding News
Task
Question Generation Task
Date
2025-08-20

Run Description

Is this run manual or automatic?
automatic
Is this run based on the provided starter kit?
no
Briefly describe this run
Prompt-based extraction of nuggets from source article. This prompt results in gold answers that are long-winded (hence "chatty"), we usually don't like these for our crucible report generation method. But they seem more appropriate for this task.
What other datasets or services (e.g. Google/Bing web search, ChatGPT, Perplexity, etc.) were used in producing the run?
Claude 4 sonnet
Briefly describe LLMs used for this run (optional)
Claude 4 sonnet
Please give this run a priority for inclusion in manual assessments.
1 (top)

Evaluation Files

Paper