====================================================== TAC KBP 2016 EVENT NUGGET DETECTION EVALUATION RESULTS ====================================================== Team ID: UI_CCG Organization: University of Illinois at Urbana-Champaign ************************************************************* Run ID: UI_CCG1 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 35.68 23.14 28.07 28.15 25.69 26.86 mention_type 27.30 17.70 21.48 20.58 19.32 19.93 realis_status 12.33 8.00 9.70 10.01 9.26 9.62 mention_type+realis_status 9.52 6.18 7.49 7.60 7.29 7.44 ==========Chinese========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 28.34 39.61 33.04 30.00 36.79 33.05 mention_type 24.01 33.55 27.99 25.44 31.57 28.17 realis_status 9.65 13.49 11.25 10.88 12.51 11.64 mention_type+realis_status 8.31 11.62 9.69 9.60 10.83 10.18 ==========Spanish========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 35.12 22.85 27.69 37.70 22.72 28.36 mention_type 26.01 16.92 20.50 27.60 16.87 20.94 realis_status 11.03 7.17 8.69 11.55 7.30 8.95 mention_type+realis_status 8.43 5.48 6.64 9.27 5.61 6.99 ************************************************************* Run ID: UI_CCG2 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 32.39 23.26 27.07 25.76 25.87 25.81 mention_type 25.81 18.53 21.57 20.14 20.29 20.21 realis_status 10.43 7.49 8.72 8.07 7.94 8.00 mention_type+realis_status 8.43 6.05 7.04 6.52 6.22 6.37 ==========Chinese========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 28.63 32.26 30.34 30.37 29.46 29.91 mention_type 24.20 27.26 25.64 25.24 25.17 25.20 realis_status 9.47 10.67 10.04 9.63 9.79 9.71 mention_type+realis_status 7.86 8.86 8.33 7.73 8.21 7.96 ==========Spanish========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 27.50 22.55 24.78 26.68 22.58 24.46 mention_type 20.66 16.95 18.62 20.61 17.31 18.82 realis_status 9.34 7.66 8.42 8.27 7.57 7.91 mention_type+realis_status 7.10 5.82 6.40 6.47 6.04 6.24