TREC 2025 Proceedings

auto_swarm_mt

Submission Details

Organization
hltcoe-multiagt
Track
RAG TREC Instrument for Multilingual Evaluation
Task
Report Generation Task
Date
2025-08-21

Run Description

Document collection
['English subset', 'Arabic subset', 'Chinese subset', 'Russian subset']
Machine translation of documents
['Yes we used the organizer-provided machine translations']
Write a short description of your retrieval process
Reciprocal ranked fusion over multilingual retrieval using plaid-x, multilingual LSR, and Qwen3 single dense vectors with ANN search.
Write a short description of your generation process
This run leverages the AutoGen framework. Multiple agents work on the answer generation: a query decomposition agent, document retrieval agent, report writing agent, report editing agent, and a report publishing agent. The query decomposer creates 3 queries at a time. The top 6 documents are used for fact extraction to identify key parts of documents. The report writing agent removes redundant facts. The report editing agent compiles the facts into an answer and determines whether more information is needed or the answer is ready to be published. After publishing an independent editor is used to ensure citation accuracy and fit the answer into the length limit. All generation is based on translated documents.
Which LLM(s) where used by your system?
Retrieval: XLMR and Qwen3-8B-Embedding; Generation: Llama-3.3-70B-Instruct
Open repository link
No
Assessing priority
3

Evaluation Files