==================================================== TAC KBP 2016 BELIEF AND SENTIMENT EVALUATION RESULTS ==================================================== Team ID: cornpittmich Organization: Cornell-Pittsburgh-Michigan ************************************************************* Run ID: cornpittmich1 Did the run access the live Web during the evaluation window: No Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere). Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned). Condition Belief Sentiment All Prec Recall F1 Prec Recall F1 Prec Recall F1 cmn-df-gold-ere 0.8393 0.8421 0.8407 0.5830 0.3032 0.3989 0.8093 0.7321 0.7688 cmn-df-pred-ere 0.0000 0.0000 0.0000 0.2400 0.0090 0.0173 0.0317 0.0020 0.0038 cmn-nw-gold-ere 0.5830 0.6092 0.5958 0.2644 0.0518 0.0866 0.5803 0.5849 0.5826 cmn-nw-pred-ere 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 eng-df-gold-ere 0.8290 0.7094 0.7646 0.1159 0.6103 0.1948 0.3236 0.6814 0.4388 eng-df-pred-ere 0.1510 0.0337 0.0551 0.0503 0.2611 0.0843 0.0591 0.1039 0.0754 eng-nw-gold-ere 0.8622 0.5313 0.6575 0.1364 0.0036 0.0070 0.8577 0.4655 0.6035 eng-nw-pred-ere 0.2417 0.0509 0.0841 1.0000 0.0000 0.0000 0.2417 0.0442 0.0747 ************************************************************* Run ID: cornpittmich2 Did the run access the live Web during the evaluation window: No Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere). Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned). Condition Belief Sentiment All Prec Recall F1 Prec Recall F1 Prec Recall F1 cmn-df-gold-ere 0.8393 0.8421 0.8407 0.4513 0.3411 0.3885 0.7765 0.7398 0.7577 cmn-df-pred-ere 0.0000 0.0000 0.0000 0.1406 0.0134 0.0245 0.0395 0.0031 0.0057 cmn-nw-gold-ere 0.5830 0.6092 0.5958 0.0821 0.1149 0.0958 0.5542 0.5877 0.5705 cmn-nw-pred-ere 0.0000 0.0000 0.0000 0.1019 0.0161 0.0278 0.0208 0.0009 0.0016 eng-df-gold-ere 0.8290 0.7094 0.7646 0.0820 0.1177 0.0967 0.5313 0.5420 0.5366 eng-df-pred-ere 0.1510 0.0337 0.0551 0.0325 0.0387 0.0354 0.0676 0.0352 0.0463 eng-nw-gold-ere 0.8622 0.5313 0.6575 0.1190 0.0020 0.0039 0.8591 0.4652 0.6035 eng-nw-pred-ere 0.2417 0.0509 0.0841 0.0556 0.0006 0.0013 0.2401 0.0443 0.0747 ************************************************************* Run ID: cornpittmich3 Did the run access the live Web during the evaluation window: No Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere). Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned). Condition Belief Sentiment All Prec Recall F1 Prec Recall F1 Prec Recall F1 cmn-df-gold-ere 0.8393 0.8421 0.8407 0.6000 0.2968 0.3972 0.8125 0.7308 0.7695 cmn-df-pred-ere 0.0000 0.0000 0.0000 0.2400 0.0090 0.0173 0.0317 0.0020 0.0038 cmn-nw-gold-ere 0.5830 0.6092 0.5958 0.2982 0.0383 0.0679 0.5814 0.5843 0.5829 cmn-nw-pred-ere 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 eng-df-gold-ere 0.8286 0.7094 0.7644 0.1157 0.6103 0.1946 0.3232 0.6814 0.4384 eng-df-pred-ere 0.1510 0.0337 0.0551 0.0503 0.2611 0.0844 0.0592 0.1039 0.0754 eng-nw-gold-ere 0.8619 0.5314 0.6575 0.1364 0.0036 0.0070 0.8575 0.4656 0.6035 eng-nw-pred-ere 0.2417 0.0509 0.0841 1.0000 0.0000 0.0000 0.2417 0.0442 0.0747