TREC 2025 Proceedings

bm25-d-rankk

Submission Details

Organization
coordinators
Track
RAG TREC Instrument for Multilingual Evaluation
Task
Multilingual Retrieval Task
Date
2025-08-21

Run Description

Document collection
['English subset', 'Arabic subset', 'Chinese subset', 'Russian subset']
Machine translation of documents
['None']
Write a short description of your retrieval process
The queries (problem statement) were translated into each language of the collection subsets using google translate. Documents were indexed in their native language, separately, using BM25. The top 250 documents of each sub-collection was reranked with Rank-1. The 4 lists were merged by score. The top 100 documents were reranked by Rank-k.
Write a short description of your generation process
NA
Which LLM(s) where used by your system?
Rank1-14B, Rankk-32B
Open repository link
https://github.com/hltcoe/patapsco, https://github.com/orionw/rank1, https://github.com/hltcoe/rank-k
Assessing priority
7

Evaluation Files