TREC 2025 Proceedings

Submission Details

Organization

ncsu-las

Track

RAG TREC Instrument for Multilingual Evaluation

Task

Report Generation Task

Date

2025-08-14

Run Description

Document collection

['English subset', 'Arabic subset', 'Chinese subset', 'Russian subset']

Machine translation of documents

['Yes we used the organizer-provided machine translations']

Write a short description of your retrieval process

track provided service

Write a short description of your generation process

autgen agentic selector pattern. all agents use gpt-4.1 and none the mini model this time.

Which LLM(s) where used by your system?

gpt-4.1

Open repository link

n/a

Assessing priority

5

Evaluation Files

• las_ag_sel_all_4.1.autoargue (autoargue)
• las_ag_sel_all_4.1.almost-human-judgments.tsv (almost-human-judgments.tsv)
• las_ag_sel_all_4.1.almost-human-scores.tsv (almost-human-scores.tsv)
• las_ag_sel_all_4.1.autoargue-scores.tsv (autoargue-scores.tsv)
• las_ag_sel_all_4.1.autoargue-judgments.jsonl (autoargue-judgments.jsonl)

Paper