TREC 2025 Proceedings

Submission Details

Organization

DUTH

Track

RAG TREC Instrument for Multilingual Evaluation

Task

Report Generation Task

Date

2025-08-22

Run Description

Document collection

['English subset']

Machine translation of documents

['None']

Write a short description of your retrieval process

BM25 baseline; single ranked list; dedup + top-1000.

Write a short description of your generation process

N/A

Which LLM(s) where used by your system?

None

Open repository link

-

Assessing priority

6

Evaluation Files

• pybm25.autoargue (autoargue)
• pybm25.almost-human-judgments.tsv (almost-human-judgments.tsv)
• pybm25.almost-human-scores.tsv (almost-human-scores.tsv)
• pybm25.autoargue-scores.tsv (autoargue-scores.tsv)
• pybm25.autoargue-judgments.jsonl (autoargue-judgments.jsonl)

Paper