==================================================== TAC KBP 2017 BELIEF AND SENTIMENT EVALUATION RESULTS ==================================================== Team ID: coolcucumber Organization: IBM Research Ireland ************************************************************* Run ID: coolcucumber_sys1 Did the run access the live Web during the evaluation window: No Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere). Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned). Condition Belief Sentiment All Prec Recall F1 Prec Recall F1 Prec Recall F1 eng-df-gold-ere 1.0000 0.0000 0.0000 0.2837 0.2186 0.2469 0.2837 0.0545 0.0914 eng-nw-gold-ere 1.0000 0.0000 0.0000 0.0716 0.1137 0.0878 0.0716 0.0148 0.0245 ************************************************************* Run ID: coolcucumber_sys2 Did the run access the live Web during the evaluation window: No Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere). Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned). Condition Belief Sentiment All Prec Recall F1 Prec Recall F1 Prec Recall F1 eng-df-gold-ere 1.0000 0.0000 0.0000 0.1722 0.4117 0.2429 0.1722 0.1026 0.1286 eng-nw-gold-ere 1.0000 0.0000 0.0000 0.0716 0.1137 0.0878 0.0716 0.0148 0.0245 ************************************************************* Run ID: coolcucumber_sys3 Did the run access the live Web during the evaluation window: No Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere). Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned). Condition Belief Sentiment All Prec Recall F1 Prec Recall F1 Prec Recall F1 eng-df-gold-ere 1.0000 0.0000 0.0000 0.2765 0.1746 0.2140 0.2765 0.0435 0.0752 eng-nw-gold-ere 1.0000 0.0000 0.0000 0.0752 0.0855 0.0800 0.0752 0.0111 0.0193