===============================================================================
TAC KBP 2016 ENTITY DISCOVERY AND LINKING EVALUATION RESULTS (FIRST EDL WINDOW)
===============================================================================


Team ID:  CMU_CS_EDL
Organization:  Carnegie Mellon University


*************************************************************

Run ID:  CMU_CS_EDL1
Did the run access the live Web during the evaluation window:  No
Did the run use the Wikipedia links in the Reference KB: Yes
Did the run use the relation/slot information encoded in the Reference KB: No
Did the run use the text descriptions in the nodes of the Reference KB: No

ALL English, Chinese, and Spanish documents:
Prec	Recall	F1	Metric
0.746	0.492	0.593	strong_typed_mention_match
0.662	0.436	0.526	strong_typed_all_match
0.671	0.405	0.505	strong_typed_link_match
0.640	0.546	0.589	strong_typed_nil_match
0.664	0.481	0.558	entity_match
0.704	0.464	0.559	mention_ceaf
0.677	0.446	0.538	typed_mention_ceaf
0.642	0.423	0.510	typed_mention_ceaf_plus
0.699	0.350	0.467	b_cubed
0.594	0.324	0.419	b_cubed_plus

ONLY English documents:
Prec	Recall	F1	Metric
0.888	0.536	0.669	strong_mention_match
0.814	0.491	0.613	strong_typed_mention_match
0.724	0.437	0.545	strong_typed_all_match
0.721	0.410	0.522	strong_typed_link_match
0.732	0.534	0.617	strong_typed_nil_match
0.746	0.505	0.603	entity_match
0.775	0.467	0.583	mention_ceaf
0.738	0.445	0.555	typed_mention_ceaf
0.700	0.423	0.527	typed_mention_ceaf_plus
0.775	0.375	0.505	b_cubed
0.674	0.341	0.453	b_cubed_plus

ONLY Chinese documents:
Prec	Recall	F1	Metric
0.721	0.508	0.596	strong_mention_match
0.671	0.473	0.555	strong_typed_mention_match
0.581	0.409	0.480	strong_typed_all_match
0.611	0.384	0.471	strong_typed_link_match
0.506	0.514	0.510	strong_typed_nil_match
0.571	0.414	0.480	entity_match
0.656	0.462	0.543	mention_ceaf
0.635	0.447	0.525	typed_mention_ceaf
0.573	0.404	0.474	typed_mention_ceaf_plus
0.626	0.354	0.452	b_cubed
0.510	0.316	0.390	b_cubed_plus

ONLY Spanish documents:
Prec	Recall	F1	Metric
0.845	0.571	0.681	strong_mention_match
0.765	0.516	0.616	strong_typed_mention_match
0.696	0.470	0.561	strong_typed_all_match
0.692	0.428	0.529	strong_typed_link_match
0.706	0.589	0.643	strong_typed_nil_match
0.668	0.518	0.583	entity_match
0.746	0.504	0.601	mention_ceaf
0.698	0.471	0.563	typed_mention_ceaf
0.663	0.448	0.534	typed_mention_ceaf_plus
0.751	0.403	0.524	b_cubed
0.644	0.370	0.470	b_cubed_plus