TREC 2025 Proceedings

Video Question Answering Multiple Choice Task Appendix

Runtag Org MRRScore Top1Correct
HIGHEST_PIPELINE (vqa_mc_eval)  (paper) NII_UIT 0.8671 0.7810
certh.vqa.mc.run_2 (vqa_mc_eval)  (paper) CERTH-ITI 0.8629 0.7679
certh.vqa.mc.run_1 (vqa_mc_eval)  (paper) CERTH-ITI 0.8510 0.7487
certh.vqa.mc.run_4 (vqa_mc_eval)  (paper) CERTH-ITI 0.7337 0.5641
certh.vqa.mc.run_3 (vqa_mc_eval)  (paper) CERTH-ITI 0.7141 0.5353
videollama-7B-vqa (vqa_mc_eval)  (paper) WHU-NERCMS 0.7063 0.5272
tv25-kslab-mc (vqa_mc_eval)  (paper) kslab 0.6921 0.5040