=======================================================================
TAC KBP 2015 DIAGNOSTIC TRILINGUAL ENTITY LINKING EVALUATION RESULTS
=======================================================================


Team ID:  sinica
Organization:  Institute of Information Science, Academia Sinica


*************************************************************

Run ID:  sinica1
Did the run access the live Web during the evaluation window:  No
Did the run use the Wikipedia links in the Reference KB: No
Did the run use the relation/slot information encoded in the Reference KB: No
Did the run use the text descriptions in the nodes of the Reference KB: No

ALL English, Chinese, and Spanish documents:
Prec	Recall	F1	Metric
0.982	0.769	0.862	strong_mention_match
0.309	0.242	0.272	strong_typed_mention_match
0.039	0.031	0.034	strong_typed_all_match
0.026	0.014	0.018	strong_typed_link_match
0.053	0.078	0.063	strong_typed_nil_match
0.125	0.098	0.110	entity_match
0.463	0.363	0.407	mention_ceaf
0.174	0.136	0.153	typed_mention_ceaf
0.030	0.023	0.026	typed_mention_ceaf_plus

ONLY English documents:
Prec	Recall	F1	Metric
0.968	0.896	0.930	strong_mention_match
0.305	0.282	0.293	strong_typed_mention_match
0.032	0.030	0.031	strong_typed_all_match
0.023	0.012	0.016	strong_typed_link_match
0.039	0.075	0.051	strong_typed_nil_match
0.150	0.127	0.138	entity_match
0.363	0.336	0.349	mention_ceaf
0.156	0.145	0.150	typed_mention_ceaf
0.021	0.020	0.021	typed_mention_ceaf_plus

ONLY Chinese documents:
Prec	Recall	F1	Metric
1.000	1.000	1.000	strong_mention_match
0.315	0.315	0.315	strong_typed_mention_match
0.048	0.048	0.048	strong_typed_all_match
0.028	0.023	0.025	strong_typed_link_match
0.082	0.138	0.103	strong_typed_nil_match
0.101	0.129	0.113	entity_match
0.660	0.659	0.660	mention_ceaf
0.223	0.223	0.223	typed_mention_ceaf
0.042	0.042	0.042	typed_mention_ceaf_plus

ONLY Spanish documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus