=============================================================================== TAC KBP 2015 EVENT NUGGET DETECTION AND COREFERENCE (TASK 2) EVALUATION RESULTS =============================================================================== Team ID: LCC Organization: Language Computer Corporation ************************************************************* Run ID: LCC1 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 78.59 49.53 60.77 75.31 48.83 59.25 mention_type 73.95 46.61 57.18 70.63 45.92 55.66 realis_status 52.18 32.89 40.35 50.87 33.17 40.15 mention_type+realis_status 49.22 31.02 38.06 47.82 31.28 37.82 =======Final Mention Coreference Results========= Metric : bcub Score : 68.28 Metric : ceafe Score : 61.99 Metric : ceafm Score : 63.81 * Metric : muc Score : 61.85 Metric : blanc Score : 58.05 Overall Average CoNLL score : 62.80 * Score not included for final CoNLL score. ************************************************************* Run ID: LCC2 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 78.61 49.47 60.72 75.17 48.60 59.03 mention_type 74.00 46.56 57.16 70.57 45.74 55.51 realis_status 52.11 32.79 40.25 50.65 32.92 39.90 mention_type+realis_status 49.17 30.94 37.98 47.68 31.09 37.64 =======Final Mention Coreference Results========= Metric : bcub Score : 67.27 Metric : ceafe Score : 61.35 Metric : ceafm Score : 63.68 * Metric : muc Score : 63.93 Metric : blanc Score : 58.52 Overall Average CoNLL score : 62.95 * Score not included for final CoNLL score. ************************************************************* Run ID: LCC3 Did the run access the live Web during the evaluation window: No =======Final Mention Detection Results========= Micro Average Macro Average Attributes Prec Rec F1 Prec Rec F1 plain 77.48 48.79 59.87 74.51 47.70 58.16 mention_type 72.92 45.91 56.35 69.87 44.91 54.67 realis_status 51.70 32.56 39.95 50.94 32.55 39.72 mention_type+realis_status 48.92 30.81 37.81 48.10 30.79 37.55 =======Final Mention Coreference Results========= Metric : bcub Score : 67.80 Metric : ceafe Score : 61.62 Metric : ceafm Score : 63.65 * Metric : muc Score : 62.30 Metric : blanc Score : 57.79 Overall Average CoNLL score : 62.63 * Score not included for final CoNLL score.