=======================================================================
TAC KBP 2015 TRILINGUAL ENTITY DISCOVERY AND LINKING EVALUATION RESULTS
=======================================================================


Team ID:  sdu
Organization:  Shandong University


*************************************************************

Run ID:  sdu1
Did the run access the live Web during the evaluation window:  No
Did the run use the Wikipedia links in the Reference KB: Yes
Did the run use the relation/slot information encoded in the Reference KB: No
Did the run use the text descriptions in the nodes of the Reference KB: No

ALL English, Chinese, and Spanish documents:
Prec	Recall	F1	Metric
0.123	0.035	0.055	strong_mention_match
0.027	0.008	0.012	strong_typed_mention_match
0.010	0.003	0.005	strong_typed_all_match
0.011	0.003	0.004	strong_typed_link_match
0.008	0.004	0.005	strong_typed_nil_match
0.665	0.137	0.227	entity_match
0.091	0.026	0.040	mention_ceaf
0.015	0.004	0.007	typed_mention_ceaf
0.010	0.003	0.004	typed_mention_ceaf_plus

ONLY English documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus

ONLY Chinese documents:
Prec	Recall	F1	Metric
0.123	0.102	0.112	strong_mention_match
0.027	0.023	0.025	strong_typed_mention_match
0.010	0.008	0.009	strong_typed_all_match
0.011	0.007	0.009	strong_typed_link_match
0.008	0.013	0.010	strong_typed_nil_match
0.665	0.440	0.530	entity_match
0.091	0.075	0.082	mention_ceaf
0.015	0.013	0.014	typed_mention_ceaf
0.010	0.008	0.009	typed_mention_ceaf_plus

ONLY Spanish documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus