====================================================== TAC KBP 2016 EVENT NUGGET DETECTION EVALUATION RESULTS ====================================================== Team ID: SYDNEY Organization: University of Sydney ************************************************************* Run ID: SYDNEY1 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 54.87 35.80 43.33 52.90 35.88 42.76 mention_type 46.48 30.33 36.70 44.45 30.04 35.85 realis_status 42.67 27.84 33.69 40.06 27.74 32.78 mention_type+realis_status 35.93 23.45 28.38 33.48 23.01 27.27 ************************************************************* Run ID: SYDNEY2 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 53.75 25.82 34.88 50.69 24.99 33.48 mention_type 45.30 21.76 29.40 42.63 20.97 28.11 realis_status 43.17 20.74 28.02 39.22 19.83 26.34 mention_type+realis_status 35.87 17.23 23.28 32.50 16.36 21.77 ************************************************************* Run ID: SYDNEY3 Did the run access the live Web during the evaluation window: No ==========English========== =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 54.28 35.42 42.86 52.12 35.80 42.44 mention_type 45.70 29.82 36.09 43.50 29.71 35.30 realis_status 41.83 27.29 33.03 39.43 27.44 32.36 mention_type+realis_status 34.94 22.80 27.59 32.65 22.51 26.65