=============================================================== TAC KBP 2015 EVENT NUGGET DETECTION (TASK 1) EVALUATION RESULTS =============================================================== Team ID: SYDNEY Organization: University of Sydney ************************************************************* Run ID: SYDNEY1 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 74.61 47.53 58.07 73.30 47.07 57.33 mention_type 66.77 42.53 51.97 65.34 42.11 51.21 realis_status 56.97 36.29 44.33 56.21 36.06 43.93 mention_type+realis_status 50.30 32.04 39.14 49.45 31.77 38.68 ************************************************************* Run ID: SYDNEY2 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 65.43 54.86 59.68 64.22 54.74 59.10 mention_type 56.89 47.70 51.89 55.64 47.59 51.30 realis_status 49.93 41.86 45.54 49.41 41.94 45.37 mention_type+realis_status 43.12 36.16 39.33 42.49 36.17 39.08 ************************************************************* Run ID: SYDNEY3 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 77.79 44.20 56.37 76.41 43.74 55.63 mention_type 70.29 39.94 50.94 68.76 39.52 50.19 realis_status 59.53 33.83 43.14 58.32 33.42 42.49 mention_type+realis_status 53.13 30.19 38.50 52.00 29.82 37.90