=======================================================================
TAC KBP 2020 RECOGNIZING ULTRA FINE-GRAINED ENTITIES EVALUATION RESULTS
=======================================================================

Team ID:  UIUC2020
Organization:  University of Illinois, Urbana Champaign

********************* Evaluation Window 1 *********************

Run ID: UIUC2020_1 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? Yes

Prec    Recall  F1      Metric
0.775	0.801	0.787	strong_mention_match
0.371	0.384	0.377	strong_typed_mention_match
0.676	0.699	0.687	mention_ceaf
0.342	0.354	0.348	typed_mention_ceaf
0.632	0.647	0.640	entity_ceaf
0.643	0.688	0.664	b_cubed
0.689	0.718	0.703	muc
0.645	0.634	0.639	pairwise
		0.1785	RUFES Type Metric (Type F1 macro-averaged over entities)

*********************

********************* Evaluation Window 2 *********************

Run ID: UIUC2020_1 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? Yes
Used Feedback from these runs from Evaluation Window 1: Run_1

Prec    Recall  F1      Metric
0.775	0.801	0.787	strong_mention_match
0.394	0.408	0.401	strong_typed_mention_match
0.676	0.699	0.687	mention_ceaf
0.363	0.375	0.369	typed_mention_ceaf
0.632	0.647	0.640	entity_ceaf
0.643	0.688	0.664	b_cubed
0.689	0.718	0.703	muc
0.645	0.634	0.639	pairwise
		0.1990	RUFES Type Metric (Type F1 macro-averaged over entities)

*********************

Run ID: UIUC2020_2 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? Yes
Used Feedback from these runs from Evaluation Window 1: Run_1

Prec    Recall  F1      Metric
0.776	0.794	0.785	strong_mention_match
0.679	0.695	0.687	strong_typed_mention_match
0.677	0.693	0.685	mention_ceaf
0.614	0.628	0.621	typed_mention_ceaf
0.634	0.642	0.638	entity_ceaf
0.644	0.684	0.663	b_cubed
0.690	0.712	0.701	muc
0.646	0.629	0.638	pairwise
		0.3825	RUFES Type Metric (Type F1 macro-averaged over entities)

*********************