==================================================== TAC KBP 2016 BELIEF AND SENTIMENT EVALUATION RESULTS ==================================================== Team ID: Columbia_GWU Organization: Columbia University ************************************************************* Run ID: Columbia_GWU1 Did the run access the live Web during the evaluation window: No Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere). Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned). Condition Belief Sentiment All Prec Recall F1 Prec Recall F1 Prec Recall F1 cmn-df-gold-ere 0.8266 0.6767 0.7442 0.1257 0.2604 0.1695 0.5506 0.5915 0.5703 cmn-df-pred-ere 0.0000 0.0000 0.0000 0.0408 0.0060 0.0104 0.0153 0.0014 0.0025 cmn-nw-gold-ere 0.7972 0.5302 0.6368 0.0249 0.0968 0.0396 0.6346 0.5113 0.5664 cmn-nw-pred-ere 0.0000 0.0000 0.0000 0.0741 0.0029 0.0056 0.0040 0.0002 0.0003 eng-df-gold-ere 0.7492 0.8104 0.7786 0.1414 0.3854 0.2069 0.4458 0.6899 0.5417 eng-df-pred-ere 0.0889 0.0226 0.0361 0.0621 0.2055 0.0953 0.0663 0.0795 0.0723 eng-nw-gold-ere 0.8379 0.5375 0.6549 0.0729 0.1647 0.1010 0.5820 0.4908 0.5325 eng-nw-pred-ere 0.2056 0.0208 0.0378 0.0273 0.0895 0.0419 0.0573 0.0299 0.0393 spa-df-gold-ere 0.5558 0.4682 0.5083 0.1654 0.3580 0.2262 0.3416 0.4332 0.3820 spa-df-pred-ere 0.0000 0.0000 0.0000 0.0739 0.0203 0.0319 0.0308 0.0065 0.0107 spa-nw-gold-ere 0.6239 0.3608 0.4572 0.1614 0.0227 0.0398 0.5988 0.2970 0.3970 spa-nw-pred-ere 0.0000 0.0000 0.0000 0.0800 0.0022 0.0042 0.0048 0.0004 0.0008 ************************************************************* Run ID: Columbia_GWU2 Did the run access the live Web during the evaluation window: No Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere). Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned). Condition Belief Sentiment All Prec Recall F1 Prec Recall F1 Prec Recall F1 cmn-df-gold-ere 0.7437 0.1112 0.1934 0.1257 0.2604 0.1695 0.2609 0.1413 0.1833 cmn-df-pred-ere 0.0000 0.0000 0.0000 0.0408 0.0060 0.0104 0.0282 0.0014 0.0026 cmn-nw-gold-ere 1.0000 0.0000 0.0000 1.0000 0.0000 0.0000 1.0000 0.0000 0.0000 cmn-nw-pred-ere 0.0000 0.0000 0.0000 0.0741 0.0029 0.0056 0.0109 0.0002 0.0003 eng-df-gold-ere 0.7742 0.2445 0.3716 0.1200 0.3831 0.1828 0.2510 0.2839 0.2665 eng-df-pred-ere 0.1431 0.0141 0.0256 0.0548 0.1837 0.0844 0.0603 0.0664 0.0632 eng-nw-gold-ere 0.8587 0.1558 0.2638 0.0425 0.0561 0.0483 0.4433 0.1435 0.2168 eng-nw-pred-ere 0.3226 0.0131 0.0251 0.0241 0.0297 0.0266 0.0767 0.0152 0.0254 spa-df-gold-ere 0.6495 0.7084 0.6777 0.1803 0.1803 0.1803 0.5072 0.5384 0.5223 spa-df-pred-ere 0.0000 0.0000 0.0000 0.0176 0.0040 0.0065 0.0065 0.0013 0.0021 spa-nw-gold-ere 0.6873 0.5181 0.5908 0.1907 0.0548 0.0852 0.6470 0.4308 0.5172 spa-nw-pred-ere 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 ************************************************************* Run ID: Columbia_GWU3 Did the run access the live Web during the evaluation window: No Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere). Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned). Condition Belief Sentiment All Prec Recall F1 Prec Recall F1 Prec Recall F1 cmn-df-gold-ere 0.7938 0.7998 0.7968 0.1257 0.2604 0.1695 0.5630 0.6894 0.6198 cmn-df-pred-ere 0.0000 0.0000 0.0000 0.0408 0.0060 0.0104 0.0135 0.0014 0.0025 cmn-nw-gold-ere 0.8083 0.5715 0.6696 0.0249 0.0968 0.0396 0.6512 0.5508 0.5968 cmn-nw-pred-ere 0.0000 0.0000 0.0000 0.0741 0.0029 0.0056 0.0040 0.0002 0.0003 eng-df-gold-ere 0.6827 0.8586 0.7606 0.1152 0.4732 0.1853 0.3629 0.7497 0.4891 eng-df-pred-ere 0.0839 0.0277 0.0417 0.0479 0.2491 0.0804 0.0526 0.0964 0.0680 eng-nw-gold-ere 0.8241 0.5565 0.6643 0.0562 0.2917 0.0943 0.4226 0.5233 0.4676 eng-nw-pred-ere 0.1933 0.0219 0.0394 0.0294 0.1357 0.0483 0.0520 0.0370 0.0433 spa-df-gold-ere 0.5563 0.4684 0.5086 1.0000 0.0000 0.0000 0.5563 0.3186 0.4051 spa-df-pred-ere 0.0000 0.0000 0.0000 1.0000 0.0000 0.0000 0.0000 0.0000 0.0000 spa-nw-gold-ere 0.6239 0.3608 0.4572 1.0000 0.0000 0.0000 0.6235 0.2927 0.3984 spa-nw-pred-ere 0.0000 0.0000 0.0000 1.0000 0.0000 0.0000 0.0000 0.0000 0.0000