===============================================================================
TAC KBP 2015 EVENT NUGGET DETECTION AND COREFERENCE (TASK 2) EVALUATION RESULTS
===============================================================================


Team ID:  RPI_BLENDER
Organization:  Rensselear Polytechnic Institute


*************************************************************

Run ID:  RPI_BLENDER1
Did the run access the live Web during the evaluation window:  No

=======Final Mention Detection Results=========
                          	     Micro Average	     Macro Average
                Attributes	Prec  	Rec  	F1   	Prec  	Rec  	F1   
                     plain	83.96	49.31	62.13	82.03	49.15	61.47
              mention_type	77.58	45.56	57.41	75.42	45.24	56.55
             realis_status	64.66	37.97	47.85	64.05	37.89	47.61
mention_type+realis_status	59.09	34.71	43.73	58.21	34.33	43.19

=======Final Mention Coreference Results=========
Metric : bcub	Score : 69.65
Metric : ceafe	Score : 64.55
Metric : ceafm	Score : 65.56 *
Metric : muc	Score : 56.86
Metric : blanc	Score : 59.51
Overall Average CoNLL score : 63.23

* Score not included for final CoNLL score.


*************************************************************

Run ID:  RPI_BLENDER2
Did the run access the live Web during the evaluation window:  No

=======Final Mention Detection Results=========
                          	     Micro Average	     Macro Average
                Attributes	Prec  	Rec  	F1   	Prec  	Rec  	F1   
                     plain	83.96	49.31	62.13	82.03	49.15	61.47
              mention_type	77.58	45.56	57.41	75.42	45.24	56.55
             realis_status	64.66	37.97	47.85	64.05	37.89	47.61
mention_type+realis_status	59.09	34.71	43.73	58.21	34.33	43.19

=======Final Mention Coreference Results=========
Metric : bcub	Score : 69.55
Metric : ceafe	Score : 64.12
Metric : ceafm	Score : 64.32 *
Metric : muc	Score : 52.84
Metric : blanc	Score : 57.24
Overall Average CoNLL score : 61.61

* Score not included for final CoNLL score.


*************************************************************

Run ID:  RPI_BLENDER3
Did the run access the live Web during the evaluation window:  No

=======Final Mention Detection Results=========
                          	     Micro Average	     Macro Average
                Attributes	Prec  	Rec  	F1   	Prec  	Rec  	F1   
                     plain	81.99	52.02	63.66	80.44	52.24	63.35
              mention_type	75.23	47.74	58.41	73.67	47.82	57.99
             realis_status	62.73	39.80	48.70	62.28	40.05	48.75
mention_type+realis_status	56.98	36.16	44.24	56.44	36.11	44.04

=======Final Mention Coreference Results=========
Metric : bcub	Score : 70.41
Metric : ceafe	Score : 61.27
Metric : ceafm	Score : 60.32 *
Metric : muc	Score : 35.26
Metric : blanc	Score : 47.94
Overall Average CoNLL score : 55.04

* Score not included for final CoNLL score.