The website_judgements.csv file is a judgment file for the Contextual Suggestion track. For a context-profile pair, this file contains each website retrieved as one of the top five suggestions by some run plus the corresponding website-interest judgment from the profile owner, the geographical appropriateness judgment, and the temporal appropriateness judgment. Description-interest judgments are not included in this file since they are run-dependent. Note that website-interest judgments were made for a subset of the context-profile pairs that have geographical and temporal judgments. The format of the file is profile-id,context-id,url,geo-judgment,temporal-judgment,website-judgment and the first line of the file is a header line giving this format. A judgment has one of the following values: -9 = Not judged (not part of judged profile-context pairs) -3 = Not judged (part of judged profile-context pairs, but no judgment assigned) -2 = Website didn't load at judgment time (only for geo and temporal judgments) 0 = Not Appropriate (for geo/temporal); Not interesting (for website) 1 = Marginally Appropriate (for geo/temporal); Indifferent (for website) 2 = Appropriate (for geo/temporal); Interesting (for website) -9 means that the suggestion was never shown to an assessor, -3 means that the suggestion does not exist (i.e., the run returned fewer than 5 suggestions) or the assessor did not judge the suggestion (but was shown it). In some cases the website-interest rating had more than one value assigned for a particular context-profile pair (i.e., the assessor gave the same website a different rating when asked to repeatedly judge it). For the purposes of this judgment file, we took the mean of the assigned judgments and set the value to 2, 1, or 0 depending on the mean: * If the mean was [2.0, 1.25) => 2 is used * If the mean was [1.25, 0.75) => 1 is used * If the mean was [0.75, 0.0] => 0 is used