====================================================================== TAC KBP 2016 EVENT NUGGET DETECTION AND COREFERENCE EVALUATION RESULTS ====================================================================== Team ID: NYU Organization: New York University ************************************************************* Run ID: NYU1 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 51.13 56.85 53.84 49.81 56.40 52.90 mention_type 42.14 46.86 44.37 40.46 45.60 42.88 realis_status 40.53 45.07 42.68 39.24 44.46 41.69 mention_type+realis_status 33.47 37.21 35.24 31.86 35.88 33.75 =======Final Mention Coreference Results========= Metric : bcub Score 34.62 Metric : ceafe Score 33.33 Metric : ceafm Score 34.30 * Metric : muc Score 22.01 Metric : blanc Score 18.31 Overall Average CoNLL score 27.07 * Score not included for final CoNLL score. ************************************************************* Run ID: NYU2 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 51.17 53.67 52.39 50.09 53.02 51.51 mention_type 43.09 45.20 44.12 41.40 43.88 42.60 realis_status 40.76 42.75 41.73 40.23 42.00 41.10 mention_type+realis_status 34.40 36.08 35.22 33.37 34.83 34.08 =======Final Mention Coreference Results========= Metric : bcub Score 34.73 Metric : ceafe Score 34.21 Metric : ceafm Score 34.53 * Metric : muc Score 18.65 Metric : blanc Score 17.52 Overall Average CoNLL score 26.28 * Score not included for final CoNLL score. ************************************************************* Run ID: NYU3 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 51.02 57.52 54.07 49.73 57.06 53.14 mention_type 41.88 47.21 44.38 40.16 45.88 42.83 realis_status 38.87 43.82 41.19 37.26 43.00 39.92 mention_type+realis_status 31.70 35.74 33.60 29.78 34.28 31.87 =======Final Mention Coreference Results========= Metric : bcub Score 34.59 Metric : ceafe Score 33.48 Metric : ceafm Score 34.39 * Metric : muc Score 21.59 Metric : blanc Score 18.10 Overall Average CoNLL score 26.94 * Score not included for final CoNLL score.