=============================================================== TAC KBP 2015 EVENT NUGGET DETECTION (TASK 1) EVALUATION RESULTS =============================================================== Team ID: HITS Organization: Heidelberg Institute for Theoretical Studies ************************************************************* Run ID: HITS1 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 89.00 35.94 51.21 86.42 36.23 51.05 mention_type 82.91 33.48 47.70 79.73 33.68 47.35 realis_status 62.58 25.27 36.00 61.33 25.63 36.15 mention_type+realis_status 57.83 23.36 33.27 55.87 23.55 33.13 ************************************************************* Run ID: HITS2 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 66.00 50.72 57.36 64.95 50.95 57.11 mention_type 55.42 42.59 48.16 54.60 42.63 47.88 realis_status 42.62 32.75 37.04 42.32 32.92 37.03 mention_type+realis_status 35.15 27.02 30.55 34.88 26.91 30.38 ************************************************************* Run ID: HITS3 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 68.37 44.35 53.80 67.26 43.82 53.07 mention_type 59.56 38.64 46.87 58.60 38.23 46.27 realis_status 45.11 29.26 35.49 44.42 28.84 34.97 mention_type+realis_status 38.76 25.14 30.50 38.16 24.75 30.02