===============================================================================
TAC KBP 2015 EVENT NUGGET DETECTION AND COREFERENCE (TASK 2) EVALUATION RESULTS
===============================================================================


Team ID:  UMBC
Organization:  University of Maryland, Baltimore County


*************************************************************

Run ID:  UMBC1
Did the run access the live Web during the evaluation window:  No

=======Final Mention Detection Results=========
                          	     Micro Average	     Macro Average
                Attributes	Prec  	Rec  	F1   	Prec  	Rec  	F1   
                     plain	29.99	34.69	32.17	30.02	35.35	32.46
              mention_type	21.55	24.93	23.12	21.55	25.21	23.24
             realis_status	16.17	18.70	17.35	16.24	19.10	17.55
mention_type+realis_status	11.10	12.84	11.91	11.09	12.95	11.95

=======Final Mention Coreference Results=========
Metric : bcub	Score : 16.34
Metric : ceafe	Score : 17.65
Metric : ceafm	Score : 17.20 *
Metric : muc	Score : 3.96
Metric : blanc	Score : 2.75
Overall Average CoNLL score : 11.58

* Score not included for final CoNLL score.


*************************************************************

Run ID:  UMBC2
Did the run access the live Web during the evaluation window:  No

=======Final Mention Detection Results=========
                          	     Micro Average	     Macro Average
                Attributes	Prec  	Rec  	F1   	Prec  	Rec  	F1   
                     plain	40.76	28.88	33.81	40.68	29.66	34.30
              mention_type	32.46	23.00	26.93	32.05	23.40	27.05
             realis_status	21.81	15.45	18.09	21.99	15.92	18.47
mention_type+realis_status	16.74	11.86	13.89	16.63	12.04	13.97

=======Final Mention Coreference Results=========
Metric : bcub	Score : 25.43
Metric : ceafe	Score : 25.73
Metric : ceafm	Score : 25.42 *
Metric : muc	Score : 6.66
Metric : blanc	Score : 5.74
Overall Average CoNLL score : 17.80

* Score not included for final CoNLL score.