------------------------------------------------
FedWeb 2014 Evaluation: Vertical Selection task
------------------------------------------------

The the perl script 'evalVS.pl' and the qrels file 'vertical-qrels.txt'
can be used to evaluate a vertical selection run.  The script calculates
the precision (P), recall (R) and F1-measure of the selected vertical(s) for
each topic.

Vertical relevance was determined using the (GMR + II) approach described in: 

K. Zhou, T. Demeester, D. Nguyen, D. Hiemstra and D. Trieschnigg.  Aligning Vertical Collection Relevance with User Intent, ACM International Conference on Information and Knowledge Management (CIKM 2014), Shanghai, China, 2014.