TREC 2025 Proceedings
garamp_qwen25_7b_imp
Submission Details
- Organization
- DUTH
- Track
- Detection, Retr., and Gen for Understanding News
- Task
- Question Generation Task
- Date
- 2025-08-21
Run Description
- Is this run manual or automatic?
- automatic
- Is this run based on the provided starter kit?
- no
- Briefly describe this run
- Zero-shot question generation for 30 topics using a fixed system prompt enforcing: ≤300 characters, one question per line, English, ends with “?”, and no compound questions (no “and/and-or”). We produce ~30 candidates per topic, clean/filter them, then select 10 via TF-IDF MMR (α=0.7). Seed=42.
- What other datasets or services (e.g. Google/Bing web search, ChatGPT, Perplexity, etc.) were used in producing the run?
- None. No web search or external services. Only Hugging Face Transformers and scikit-learn locally.
- Briefly describe LLMs used for this run (optional)
- Instruction-tuned LLM (Qwen2.5-7B-Instruct). Decoding: temperature=0.4, top_p=0.85, do_sample=True, no_repeat_ngram_size=4, repetition_penalty=1.1. TF-IDF cosine similarity + MMR (α=0.7). No training/finetuning.
- Please give this run a priority for inclusion in manual assessments.
- 1 (top)
Evaluation Files
Paper