======================================================================
TAC KBP 2016 EVENT NUGGET DETECTION AND COREFERENCE EVALUATION RESULTS
======================================================================


Team ID:  UI_CCG
Organization:  University of Illinois at Urbana-Champaign


*************************************************************

Run ID:  UI_CCG1
Did the run access the live Web during the evaluation window:  No

	==========English==========

=======Final Mention Detection Results=========
                          	     Micro Average	     Macro Average
                Attributes	Prec  	Rec  	F1   	Prec  	Rec  	F1   
                     plain	35.68	23.14	28.07	28.15	25.69	26.86
              mention_type	27.30	17.70	21.48	20.58	19.32	19.93
             realis_status	12.33	8.00	9.70	10.01	9.26	9.62
mention_type+realis_status	9.52	6.18	7.49	7.60	7.29	7.44

=======Final Mention Coreference Results=========
Metric : bcub	Score	9.36
Metric : ceafe	Score	8.57
Metric : ceafm	Score	10.51 *
Metric : muc	Score	4.06
Metric : blanc	Score	2.29
Overall Average CoNLL score	6.07

* Score not included for final CoNLL score.

	==========Chinese==========

=======Final Mention Detection Results=========
                          	     Micro Average	     Macro Average
                Attributes	Prec  	Rec  	F1   	Prec  	Rec  	F1   
                     plain	28.34	39.61	33.04	30.00	36.79	33.05
              mention_type	24.01	33.55	27.99	25.44	31.57	28.17
             realis_status	9.65	13.49	11.25	10.88	12.51	11.64
mention_type+realis_status	8.31	11.62	9.69	9.60	10.83	10.18

=======Final Mention Coreference Results=========
Metric : bcub	Score	16.34
Metric : ceafe	Score	17.38
Metric : ceafm	Score	17.59 *
Metric : muc	Score	7.15
Metric : blanc	Score	5.46
Overall Average CoNLL score	11.58

* Score not included for final CoNLL score.

	==========Spanish==========

=======Final Mention Detection Results=========
                          	     Micro Average	     Macro Average
                Attributes	Prec  	Rec  	F1   	Prec  	Rec  	F1   
                     plain	35.12	22.85	27.69	37.70	22.72	28.36
              mention_type	26.01	16.92	20.50	27.60	16.87	20.94
             realis_status	11.03	7.17	8.69	11.55	7.30	8.95
mention_type+realis_status	8.43	5.48	6.64	9.27	5.61	6.99

=======Final Mention Coreference Results=========
Metric : bcub	Score	11.25
Metric : ceafe	Score	10.50
Metric : ceafm	Score	11.75 *
Metric : muc	Score	6.76
Metric : blanc	Score	3.24
Overall Average CoNLL score	7.94

* Score not included for final CoNLL score.


*************************************************************

Run ID:  UI_CCG2
Did the run access the live Web during the evaluation window:  No

	==========English==========

=======Final Mention Detection Results=========
                          	     Micro Average	     Macro Average
                Attributes	Prec  	Rec  	F1   	Prec  	Rec  	F1   
                     plain	32.39	23.26	27.07	25.76	25.87	25.81
              mention_type	25.81	18.53	21.57	20.14	20.29	20.21
             realis_status	10.43	7.49	8.72	8.07	7.94	8.00
mention_type+realis_status	8.43	6.05	7.04	6.52	6.22	6.37

=======Final Mention Coreference Results=========
Metric : bcub	Score	11.92
Metric : ceafe	Score	11.54
Metric : ceafm	Score	12.74 *
Metric : muc	Score	4.34
Metric : blanc	Score	3.10
Overall Average CoNLL score	7.73

* Score not included for final CoNLL score.

	==========Chinese==========

=======Final Mention Detection Results=========
                          	     Micro Average	     Macro Average
                Attributes	Prec  	Rec  	F1   	Prec  	Rec  	F1   
                     plain	28.63	32.26	30.34	30.37	29.46	29.91
              mention_type	24.20	27.26	25.64	25.24	25.17	25.20
             realis_status	9.47	10.67	10.04	9.63	9.79	9.71
mention_type+realis_status	7.86	8.86	8.33	7.73	8.21	7.96

=======Final Mention Coreference Results=========
Metric : bcub	Score	16.08
Metric : ceafe	Score	16.85
Metric : ceafm	Score	16.43 *
Metric : muc	Score	6.78
Metric : blanc	Score	5.12
Overall Average CoNLL score	11.21

* Score not included for final CoNLL score.

	==========Spanish==========

=======Final Mention Detection Results=========
                          	     Micro Average	     Macro Average
                Attributes	Prec  	Rec  	F1   	Prec  	Rec  	F1   
                     plain	27.50	22.55	24.78	26.68	22.58	24.46
              mention_type	20.66	16.95	18.62	20.61	17.31	18.82
             realis_status	9.34	7.66	8.42	8.27	7.57	7.91
mention_type+realis_status	7.10	5.82	6.40	6.47	6.04	6.24

=======Final Mention Coreference Results=========
Metric : bcub	Score	9.62
Metric : ceafe	Score	9.24
Metric : ceafm	Score	10.24 *
Metric : muc	Score	5.06
Metric : blanc	Score	2.65
Overall Average CoNLL score	6.64

* Score not included for final CoNLL score.