TREC 2025 Proceedings
bm25-d-rankk
Submission Details
- Organization
- coordinators
- Track
- RAG TREC Instrument for Multilingual Evaluation
- Task
- Multilingual Retrieval Task
- Date
- 2025-08-21
Run Description
- Document collection
- ['English subset', 'Arabic subset', 'Chinese subset', 'Russian subset']
- Machine translation of documents
- ['None']
- Write a short description of your retrieval process
- The queries (problem statement) were translated into each language of the collection subsets using google translate. Documents were indexed in their native language, separately, using BM25. The top 250 documents of each sub-collection was reranked with Rank-1. The 4 lists were merged by score. The top 100 documents were reranked by Rank-k.
- Write a short description of your generation process
- NA
- Which LLM(s) where used by your system?
- Rank1-14B, Rankk-32B
- Open repository link
- https://github.com/hltcoe/patapsco, https://github.com/orionw/rank1, https://github.com/hltcoe/rank-k
- Assessing priority
- 7
Evaluation Files