infolab_UD_run4 — LLM Ranking Task

Is the run manual or automatic?: automatic
Did you use the response metadata?: no
Did you use any additional data or external knowledge?: yes
Did you use the development set?: yes
Did you train on the development set?: yes
Provide a description of this run, including details about your answers above.: Run 4: MLP Classifier Ranking. Consists of three main components: 1. Weak labeling: discovery datasets were labeled with an LLM as a judge on how good the answers were given the query. 2. Queries and answers encoding 3. MLP Classifier training At inference: New query -> encoded -> MLP Classifier -> prediction and probability distribution *Run Type: Automatic and External – no manual intervention was performed after seeing the test queries. And, it is external because an LLM was used for weak labeling.
Priority for pooling: 4