==================================================== TAC KBP 2017 BELIEF AND SENTIMENT EVALUATION RESULTS ==================================================== Team ID: Albany Organization: SUNY Albany ************************************************************* Run ID: Albany_sys1 Did the run access the live Web during the evaluation window: No Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere). Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned). Condition Belief Sentiment All Prec Recall F1 Prec Recall F1 Prec Recall F1 eng-df-gold-ere 1.0000 0.0000 0.0000 0.0948 0.4009 0.1533 0.0948 0.0999 0.0973 eng-df-pred-ere 1.0000 0.0000 0.0000 0.0503 0.0743 0.0600 0.0503 0.0186 0.0272 eng-nw-gold-ere 1.0000 0.0000 0.0000 0.0424 0.1842 0.0689 0.0424 0.0239 0.0306 eng-nw-pred-ere 1.0000 0.0000 0.0000 0.0192 0.0216 0.0204 0.0192 0.0030 0.0052 ************************************************************* Run ID: Albany_sys2 Did the run access the live Web during the evaluation window: No Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere). Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned). Condition Belief Sentiment All Prec Recall F1 Prec Recall F1 Prec Recall F1 eng-df-gold-ere 1.0000 0.0000 0.0000 0.1094 0.2607 0.1541 0.1094 0.0650 0.0815 eng-df-pred-ere 1.0000 0.0000 0.0000 0.0672 0.0282 0.0397 0.0672 0.0071 0.0128 eng-nw-gold-ere 1.0000 0.0000 0.0000 0.0782 0.0403 0.0532 0.0782 0.0052 0.0098 eng-nw-pred-ere 1.0000 0.0000 0.0000 0.0214 0.0031 0.0054 0.0214 0.0004 0.0008 ************************************************************* Run ID: Albany_sys3 Did the run access the live Web during the evaluation window: No Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere). Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned). Condition Belief Sentiment All Prec Recall F1 Prec Recall F1 Prec Recall F1 eng-df-gold-ere 1.0000 0.0000 0.0000 0.0948 0.4009 0.1533 0.0948 0.0999 0.0973 eng-df-pred-ere 1.0000 0.0000 0.0000 0.0503 0.0743 0.0600 0.0503 0.0186 0.0272 eng-nw-gold-ere 1.0000 0.0000 0.0000 0.0424 0.1842 0.0689 0.0424 0.0239 0.0306 eng-nw-pred-ere 1.0000 0.0000 0.0000 0.0192 0.0216 0.0204 0.0192 0.0030 0.0052