TREC 2025 Proceedings

Team02_Task1

Submission Details

Organization
SCIAI
Track
Detection, Retr., and Gen for Understanding News
Task
Question Generation Task
Date
2025-08-18

Run Description

Is this run manual or automatic?
automatic
Is this run based on the provided starter kit?
no
Briefly describe this run
For each article, 60 questions were generated. Using a pre trained model based on the rankings of questions generated from 2024, the 60 questions were sorted from best to worst. Any questions deemed too similar to other questions are removed. Finally, the top 10 questions are used in the final report.
What other datasets or services (e.g. Google/Bing web search, ChatGPT, Perplexity, etc.) were used in producing the run?
ChatGPT (gpt-o4)
Briefly describe LLMs used for this run (optional)
Please give this run a priority for inclusion in manual assessments.
4

Evaluation Files

Paper