=============================================================================== TAC KBP 2015 EVENT NUGGET DETECTION AND COREFERENCE (TASK 2) EVALUATION RESULTS =============================================================================== Team ID: UI_CCG Organization: University of Illinois at Urbana Champaign ************************************************************* Run ID: UI_CCG1 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 84.49 43.44 57.38 82.43 43.78 57.19 mention_type 70.32 36.16 47.76 65.96 36.16 46.71 realis_status 58.87 30.27 39.98 57.46 30.36 39.73 mention_type+realis_status 50.16 25.79 34.07 47.39 25.67 33.30 =======Final Mention Coreference Results========= Metric : bcub Score : 68.80 Metric : ceafe Score : 60.78 Metric : ceafm Score : 61.86 * Metric : muc Score : 53.29 Metric : blanc Score : 56.92 Overall Average CoNLL score : 60.33 * Score not included for final CoNLL score. ************************************************************* Run ID: UI_CCG2 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 83.52 45.03 58.51 80.77 45.19 57.96 mention_type 69.29 37.36 48.54 64.93 37.26 47.35 realis_status 58.56 31.57 41.03 56.84 31.59 40.61 mention_type+realis_status 49.45 26.66 34.64 46.69 26.50 33.81 =======Final Mention Coreference Results========= Metric : bcub Score : 68.31 Metric : ceafe Score : 60.48 Metric : ceafm Score : 61.60 * Metric : muc Score : 52.78 Metric : blanc Score : 55.90 Overall Average CoNLL score : 59.81 * Score not included for final CoNLL score. ************************************************************* Run ID: UI_CCG3 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 82.22 46.99 59.80 79.91 47.41 59.51 mention_type 67.95 38.83 49.42 64.17 38.99 48.51 realis_status 58.94 33.68 42.87 57.54 34.23 42.93 mention_type+realis_status 49.88 28.50 36.28 47.59 28.78 35.87 =======Final Mention Coreference Results========= Metric : bcub Score : 67.88 Metric : ceafe Score : 59.55 Metric : ceafm Score : 61.01 * Metric : muc Score : 52.41 Metric : blanc Score : 55.07 Overall Average CoNLL score : 59.18 * Score not included for final CoNLL score.