====================================================== TAC KBP 2016 EVENT NUGGET DETECTION EVALUATION RESULTS ====================================================== Team ID: RPI_BLENDER Organization: Rensselaer Polytechnic Institute ************************************************************* Run ID: RPI_BLENDER1 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 51.48 46.11 48.65 49.15 45.56 47.29 mention_type 44.42 39.79 41.98 41.71 39.09 40.36 realis_status 36.47 32.67 34.46 35.10 32.40 33.70 mention_type+realis_status 31.87 28.55 30.12 30.23 28.11 29.13 ==========Chinese========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 62.46 18.48 28.52 46.56 17.11 25.03 mention_type 59.02 17.46 26.95 44.06 16.35 23.85 realis_status 47.87 14.16 21.86 32.61 12.36 17.93 mention_type+realis_status 45.86 13.57 20.94 31.23 11.96 17.29 ==========Spanish========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 48.11 51.31 49.66 47.73 50.38 49.02 mention_type 35.31 37.67 36.45 34.70 37.03 35.83 realis_status 35.90 38.29 37.06 35.42 36.85 36.12 mention_type+realis_status 25.96 27.69 26.79 25.07 26.43 25.73 ************************************************************* Run ID: RPI_BLENDER2 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 51.45 46.09 48.62 49.14 45.55 47.28 mention_type 44.51 39.87 42.07 41.85 39.14 40.45 realis_status 36.43 32.63 34.43 35.08 32.39 33.68 mention_type+realis_status 31.92 28.59 30.16 30.29 28.11 29.16 ==========Chinese========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 63.09 18.44 28.54 46.82 17.08 25.03 mention_type 59.87 17.50 27.08 44.58 16.34 23.92 realis_status 48.46 14.16 21.92 32.88 12.36 17.97 mention_type+realis_status 46.69 13.65 21.12 31.76 11.99 17.41 ==========Spanish========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 48.11 51.31 49.66 47.73 50.38 49.02 mention_type 36.06 38.47 37.23 35.48 37.02 36.23 realis_status 35.90 38.29 37.06 35.42 36.85 36.12 mention_type+realis_status 26.67 28.45 27.53 25.76 26.92 26.33 ************************************************************* Run ID: RPI_BLENDER3 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 51.45 46.09 48.62 49.14 45.55 47.28 mention_type 44.51 39.87 42.07 41.85 39.14 40.45 realis_status 36.43 32.63 34.43 35.08 32.39 33.68 mention_type+realis_status 31.92 28.59 30.16 30.29 28.11 29.16 ==========Chinese========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 62.46 18.48 28.52 46.56 17.11 25.03 mention_type 59.02 17.46 26.95 44.06 16.35 23.85 realis_status 47.87 14.16 21.86 32.61 12.36 17.93 mention_type+realis_status 45.86 13.57 20.94 31.23 11.96 17.29 ==========Spanish========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 48.11 51.31 49.66 47.73 50.38 49.02 mention_type 35.31 37.67 36.45 34.70 37.03 35.83 realis_status 35.90 38.29 37.06 35.42 36.85 36.12 mention_type+realis_status 25.96 27.69 26.79 25.07 26.43 25.73