=======================================================================
TAC KBP 2015 TRILINGUAL ENTITY DISCOVERY AND LINKING EVALUATION RESULTS
=======================================================================


Team ID:  ZJU_DCD_EDL
Organization:  Zhejiang University-Digital Media Computing & Design Lab


*************************************************************

Run ID:  ZJU_DCD_EDL1
Did the run access the live Web during the evaluation window:  No
Did the run use the Wikipedia links in the Reference KB: Yes
Did the run use the relation/slot information encoded in the Reference KB: No
Did the run use the text descriptions in the nodes of the Reference KB: Yes

ALL English, Chinese, and Spanish documents:
Prec	Recall	F1	Metric
0.797	0.265	0.398	strong_mention_match
0.709	0.236	0.354	strong_typed_mention_match
0.622	0.207	0.310	strong_typed_all_match
0.601	0.207	0.308	strong_typed_link_match
0.693	0.206	0.318	strong_typed_nil_match
0.636	0.285	0.394	entity_match
0.732	0.243	0.365	mention_ceaf
0.662	0.220	0.330	typed_mention_ceaf
0.615	0.204	0.307	typed_mention_ceaf_plus

ONLY English documents:
Prec	Recall	F1	Metric
0.797	0.559	0.657	strong_mention_match
0.709	0.497	0.585	strong_typed_mention_match
0.622	0.436	0.513	strong_typed_all_match
0.601	0.451	0.516	strong_typed_link_match
0.693	0.399	0.506	strong_typed_nil_match
0.636	0.633	0.635	entity_match
0.732	0.513	0.603	mention_ceaf
0.662	0.464	0.545	typed_mention_ceaf
0.615	0.431	0.507	typed_mention_ceaf_plus

ONLY Chinese documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus

ONLY Spanish documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus


*************************************************************

Run ID:  ZJU_DCD_EDL2
Did the run access the live Web during the evaluation window:  No
Did the run use the Wikipedia links in the Reference KB: Yes
Did the run use the relation/slot information encoded in the Reference KB: No
Did the run use the text descriptions in the nodes of the Reference KB: Yes

ALL English, Chinese, and Spanish documents:
Prec	Recall	F1	Metric
0.805	0.285	0.421	strong_mention_match
0.718	0.254	0.375	strong_typed_mention_match
0.634	0.224	0.332	strong_typed_all_match
0.617	0.231	0.336	strong_typed_link_match
0.693	0.206	0.318	strong_typed_nil_match
0.638	0.293	0.402	entity_match
0.739	0.262	0.387	mention_ceaf
0.671	0.237	0.351	typed_mention_ceaf
0.627	0.222	0.328	typed_mention_ceaf_plus

ONLY English documents:
Prec	Recall	F1	Metric
0.805	0.601	0.688	strong_mention_match
0.718	0.536	0.614	strong_typed_mention_match
0.634	0.474	0.542	strong_typed_all_match
0.617	0.504	0.555	strong_typed_link_match
0.693	0.399	0.506	strong_typed_nil_match
0.638	0.651	0.645	entity_match
0.739	0.552	0.632	mention_ceaf
0.671	0.501	0.574	typed_mention_ceaf
0.627	0.469	0.536	typed_mention_ceaf_plus

ONLY Chinese documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus

ONLY Spanish documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus