TREC 2025 Proceedings
Team02_Task1
Submission Details
- Organization
- SCIAI
- Track
- Detection, Retr., and Gen for Understanding News
- Task
- Question Generation Task
- Date
- 2025-08-18
Run Description
- Is this run manual or automatic?
- automatic
- Is this run based on the provided starter kit?
- no
- Briefly describe this run
- For each article, 60 questions were generated. Using a pre trained model based on the rankings of questions generated from 2024, the 60 questions were sorted from best to worst. Any questions deemed too similar to other questions are removed. Finally, the top 10 questions are used in the final report.
- What other datasets or services (e.g. Google/Bing web search, ChatGPT, Perplexity, etc.) were used in producing the run?
- ChatGPT (gpt-o4)
- Briefly describe LLMs used for this run (optional)
- Please give this run a priority for inclusion in manual assessments.
- 4
Evaluation Files
Paper