TREC 2025 Proceedings

WueRAG_2025_08_22

Submission Details

Organization
WueRAG
Track
RAG TREC Instrument for Multilingual Evaluation
Task
Report Generation Task
Date
2025-08-22

Run Description

Document collection
['English subset']
Machine translation of documents
['None']
Write a short description of your retrieval process
The retrieval process starts by reformulating the user query for better search relevance. Depending on configuration, the system either queries a remote RAGTIME API or searches local indices (for the last submission the RAGTIME API was used with subset set to "eng"). Retrieved documents are converted into a temporary index and processed via an embedding-based and BM25 retriever, in an hybrid setting.
Write a short description of your generation process
The generation process uses the retrieved nodes to produce a final answer straight forward. A response synthesizer applies a prompt template instructing the model to answer strictly from the provided sources and cite them inline. The synthesizer also refines responses using a citation-aware template to ensure factual accuracy. If the response does not fit the problem_statement (in terms of content or length limits,...), the process gets repeated.
Which LLM(s) where used by your system?
sentence-transformers/all-MiniLM-L6-v2 for embedding and gpt4o for generation
Open repository link
-
Assessing priority
5

Evaluation Files

Paper