TREC 2025 Proceedings

Submission Details

Organization

hltcoe-rerank

Track

RAG TREC Instrument for Multilingual Evaluation

Task

Report Generation Task

Date

2025-08-21

Run Description

Document collection

['English subset', 'Arabic subset', 'Chinese subset', 'Russian subset']

Machine translation of documents

['Yes we used the organizer-provided machine translations']

Write a short description of your retrieval process

Llama-3.3-70B-Instruct listwise reranking RRF of PLAID-X, Qwen-Embedding-8B, and multilingual LSR. Translations were not used for first-stage retrieval.

Write a short description of your generation process

LangGraph generator (reflection, note taking, query generation, etc). LangGraph uses Llama 3.3 70B for all steps. LangGraph generates 4 initial queries, retrieves 12 results per query, and runs up to 5 research loops.

Which LLM(s) where used by your system?

Llama-3.3-70B

Open repository link

NA

Assessing priority

7

Evaluation Files

• hltime-lg.listllama.autoargue (autoargue)
• hltime-lg.listllama.almost-human-judgments.tsv (almost-human-judgments.tsv)
• hltime-lg.listllama.almost-human-scores.tsv (almost-human-scores.tsv)
• hltime-lg.listllama.autoargue-scores.tsv (autoargue-scores.tsv)
• hltime-lg.listllama.autoargue-judgments.jsonl (autoargue-judgments.jsonl)