====================================================== TAC KBP 2016 EVENT NUGGET DETECTION EVALUATION RESULTS ====================================================== Team ID: CMUML Organization: Carnegie Mellon University ************************************************************* Run ID: CMUML1 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 71.44 18.11 28.89 58.70 16.99 26.35 mention_type 61.09 15.48 24.70 46.96 14.12 21.71 realis_status 51.76 13.12 20.93 43.57 12.14 18.99 mention_type+realis_status 44.16 11.19 17.86 34.23 10.01 15.48 ************************************************************* Run ID: CMUML2 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 72.19 17.91 28.70 58.95 16.71 26.04 mention_type 61.81 15.34 24.58 47.35 13.91 21.50 realis_status 52.18 12.95 20.75 43.39 11.96 18.75 mention_type+realis_status 44.71 11.10 17.78 34.22 9.90 15.36 ************************************************************* Run ID: CMUML3 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 71.27 18.37 29.21 58.66 17.26 26.67 mention_type 60.44 15.58 24.77 46.74 14.21 21.79 realis_status 51.54 13.29 21.13 43.45 12.25 19.11 mention_type+realis_status 43.60 11.24 17.87 33.98 10.01 15.46