====================================================================== TAC KBP 2016 EVENT NUGGET DETECTION AND COREFERENCE EVALUATION RESULTS ====================================================================== Team ID: UTD Organization: University of Texas at Dallas ************************************************************* Run ID: UTD1 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 55.36 53.85 54.59 53.12 52.45 52.78 mention_type 47.66 46.35 46.99 45.61 44.78 45.19 realis_status 40.34 39.23 39.78 37.85 37.94 37.90 mention_type+realis_status 34.05 33.12 33.58 31.91 31.73 31.82 =======Final Mention Coreference Results========= Metric : bcub Score 37.22 Metric : ceafe Score 33.83 Metric : ceafm Score 35.94 * Metric : muc Score 26.21 Metric : blanc Score 22.10 Overall Average CoNLL score 29.84 * Score not included for final CoNLL score. ==========Chinese========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 47.23 43.16 45.10 45.13 41.89 43.45 mention_type 41.90 38.29 40.01 39.89 37.60 38.71 realis_status 35.27 32.23 33.68 34.41 31.74 33.02 mention_type+realis_status 31.76 29.02 30.33 30.63 28.89 29.73 =======Final Mention Coreference Results========= Metric : bcub Score 32.83 Metric : ceafe Score 30.82 Metric : ceafm Score 31.95 * Metric : muc Score 24.27 Metric : blanc Score 17.80 Overall Average CoNLL score 26.43 * Score not included for final CoNLL score. ************************************************************* Run ID: UTD2 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 55.36 53.85 54.59 53.12 52.45 52.78 mention_type 47.66 46.35 46.99 45.61 44.78 45.19 realis_status 40.34 39.23 39.78 37.85 37.94 37.90 mention_type+realis_status 34.05 33.12 33.58 31.91 31.73 31.82 =======Final Mention Coreference Results========= Metric : bcub Score 37.49 Metric : ceafe Score 34.21 Metric : ceafm Score 36.26 * Metric : muc Score 26.37 Metric : blanc Score 22.25 Overall Average CoNLL score 30.08 * Score not included for final CoNLL score. ==========Chinese========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 47.23 43.16 45.10 45.13 41.89 43.45 mention_type 41.90 38.29 40.01 39.89 37.60 38.71 realis_status 35.27 32.23 33.68 34.41 31.74 33.02 mention_type+realis_status 31.76 29.02 30.33 30.63 28.89 29.73 =======Final Mention Coreference Results========= Metric : bcub Score 32.60 Metric : ceafe Score 30.39 Metric : ceafm Score 30.75 * Metric : muc Score 16.23 Metric : blanc Score 13.83 Overall Average CoNLL score 23.26 * Score not included for final CoNLL score.