=============================================================================== TAC KBP 2015 EVENT NUGGET DETECTION AND COREFERENCE (TASK 2) EVALUATION RESULTS =============================================================================== Team ID: BUPT_PRIS Organization: Beijing University of Posts and Telecommunications ************************************************************* Run ID: BUPT_PRIS1 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 46.31 37.29 41.31 46.60 37.62 41.63 mention_type 35.20 28.35 31.41 35.43 28.70 31.71 realis_status 30.40 24.48 27.12 30.83 24.43 27.26 mention_type+realis_status 22.61 18.21 20.17 23.03 18.27 20.37 =======Final Mention Coreference Results========= Metric : bcub Score : 44.57 Metric : ceafe Score : 35.52 Metric : ceafm Score : 35.81 * Metric : muc Score : 3.56 Metric : blanc Score : 12.21 Overall Average CoNLL score : 26.33 * Score not included for final CoNLL score. ************************************************************* Run ID: BUPT_PRIS2 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 42.05 34.02 37.61 43.51 35.56 39.14 mention_type 25.34 20.50 22.66 27.19 21.44 23.98 realis_status 33.26 26.90 29.74 34.89 27.81 30.95 mention_type+realis_status 19.58 15.84 17.51 21.39 16.41 18.57 =======Final Mention Coreference Results========= Metric : bcub Score : 37.85 Metric : ceafe Score : 34.08 Metric : ceafm Score : 33.58 * Metric : muc Score : 2.75 Metric : blanc Score : 7.24 Overall Average CoNLL score : 23.10 * Score not included for final CoNLL score. ************************************************************* Run ID: BUPT_PRIS3 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 45.80 58.50 51.38 46.73 59.40 52.31 mention_type 31.35 40.05 35.17 32.48 40.43 36.02 realis_status 33.37 42.63 37.44 34.60 43.16 38.41 mention_type+realis_status 22.11 28.25 24.81 23.40 28.42 25.66 =======Final Mention Coreference Results========= Metric : bcub Score : 40.85 Metric : ceafe Score : 32.55 Metric : ceafm Score : 32.60 * Metric : muc Score : 3.80 Metric : blanc Score : 10.32 Overall Average CoNLL score : 24.02 * Score not included for final CoNLL score.