======================================================================
TAC KBP 2016 EVENT NUGGET DETECTION AND COREFERENCE EVALUATION RESULTS
======================================================================


Team ID:  CMUML
Organization:  Carnegie Mellon University


*************************************************************

Run ID:  CMUML1
Did the run access the live Web during the evaluation window:  No

	==========English==========

=======Final Mention Detection Results=========
                          	     Micro Average	     Macro Average
                Attributes	Prec  	Rec  	F1   	Prec  	Rec  	F1   
                     plain	71.44	18.11	28.89	58.70	16.99	26.35
              mention_type	61.09	15.48	24.70	46.96	14.12	21.71
             realis_status	51.76	13.12	20.93	43.57	12.14	18.99
mention_type+realis_status	44.16	11.19	17.86	34.23	10.01	15.48

=======Final Mention Coreference Results=========
Metric : bcub	Score	19.74
Metric : ceafe	Score	16.13
Metric : ceafm	Score	18.47 *
Metric : muc	Score	16.05
Metric : blanc	Score	8.92
Overall Average CoNLL score	15.21

* Score not included for final CoNLL score.


*************************************************************

Run ID:  CMUML2
Did the run access the live Web during the evaluation window:  No

	==========English==========

=======Final Mention Detection Results=========
                          	     Micro Average	     Macro Average
                Attributes	Prec  	Rec  	F1   	Prec  	Rec  	F1   
                     plain	72.19	17.91	28.70	58.95	16.71	26.04
              mention_type	61.81	15.34	24.58	47.35	13.91	21.50
             realis_status	52.18	12.95	20.75	43.39	11.96	18.75
mention_type+realis_status	44.71	11.10	17.78	34.22	9.90	15.36

=======Final Mention Coreference Results=========
Metric : bcub	Score	19.36
Metric : ceafe	Score	16.27
Metric : ceafm	Score	18.16 *
Metric : muc	Score	14.75
Metric : blanc	Score	7.99
Overall Average CoNLL score	14.59

* Score not included for final CoNLL score.


*************************************************************

Run ID:  CMUML3
Did the run access the live Web during the evaluation window:  No

	==========English==========

=======Final Mention Detection Results=========
                          	     Micro Average	     Macro Average
                Attributes	Prec  	Rec  	F1   	Prec  	Rec  	F1   
                     plain	71.27	18.37	29.21	58.66	17.26	26.67
              mention_type	60.44	15.58	24.77	46.74	14.21	21.79
             realis_status	51.54	13.29	21.13	43.45	12.25	19.11
mention_type+realis_status	43.60	11.24	17.87	33.98	10.01	15.46

=======Final Mention Coreference Results=========
Metric : bcub	Score	19.75
Metric : ceafe	Score	15.89
Metric : ceafm	Score	18.36 *
Metric : muc	Score	16.21
Metric : blanc	Score	8.91
Overall Average CoNLL score	15.19

* Score not included for final CoNLL score.