TREC 2025 Proceedings

garamp_mistral_7b

Submission Details

Organization
DUTH
Track
Detection, Retr., and Gen for Understanding News
Task
Question Generation Task
Date
2025-08-21

Run Description

Is this run manual or automatic?
automatic
Is this run based on the provided starter kit?
no
Briefly describe this run
Zero-shot with Mistral-7B-Instruct-v0.3. We create ~30 candidates/topic under strict formatting/length rules and remove compound questions, then pick the final 10 via TF-IDF MMR (α=0.7). Seed=42.
What other datasets or services (e.g. Google/Bing web search, ChatGPT, Perplexity, etc.) were used in producing the run?
None beyond the HF model/tokenizer and scikit-learn. No web search or external APIs.
Briefly describe LLMs used for this run (optional)
Mistral-7B-Instruct-v0.3; temperature=0.4, top_p=0.85, do_sample=True, no_repeat_ngram_size=4, repetition_penalty=1.1. TF-IDF cosine + MMR (α=0.7). No additional training.
Please give this run a priority for inclusion in manual assessments.
5 (bottom)

Evaluation Files

Paper