=======================================================================
TAC KBP 2015 DIAGNOSTIC TRILINGUAL ENTITY LINKING EVALUATION RESULTS
=======================================================================


Team ID:  GWU
Organization:  George Washington University


*************************************************************

Run ID:  GWU1
Did the run access the live Web during the evaluation window:  No
Did the run use the Wikipedia links in the Reference KB: No
Did the run use the relation/slot information encoded in the Reference KB: Yes
Did the run use the text descriptions in the nodes of the Reference KB: Yes

ALL English, Chinese, and Spanish documents:
Prec	Recall	F1	Metric
0.968	0.424	0.589	strong_mention_match
0.616	0.270	0.375	strong_typed_mention_match
0.462	0.202	0.281	strong_typed_all_match
0.681	0.152	0.249	strong_typed_link_match
0.329	0.345	0.337	strong_typed_nil_match
0.602	0.128	0.212	entity_match
0.600	0.263	0.366	mention_ceaf
0.463	0.203	0.282	typed_mention_ceaf
0.394	0.173	0.240	typed_mention_ceaf_plus

ONLY English documents:
Prec	Recall	F1	Metric
0.968	0.894	0.930	strong_mention_match
0.616	0.569	0.591	strong_typed_mention_match
0.462	0.427	0.444	strong_typed_all_match
0.681	0.332	0.446	strong_typed_link_match
0.329	0.666	0.441	strong_typed_nil_match
0.602	0.285	0.387	entity_match
0.000	0.000	0.000	mention_ceaf
0.463	0.428	0.445	typed_mention_ceaf
0.394	0.365	0.379	typed_mention_ceaf_plus

ONLY Chinese documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus

ONLY Spanish documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus


*************************************************************

Run ID:  GWU2
Did the run access the live Web during the evaluation window:  No
Did the run use the Wikipedia links in the Reference KB: No
Did the run use the relation/slot information encoded in the Reference KB: Yes
Did the run use the text descriptions in the nodes of the Reference KB: Yes

ALL English, Chinese, and Spanish documents:
Prec	Recall	F1	Metric
0.968	0.424	0.589	strong_mention_match
0.616	0.270	0.375	strong_typed_mention_match
0.462	0.202	0.281	strong_typed_all_match
0.681	0.152	0.249	strong_typed_link_match
0.329	0.345	0.337	strong_typed_nil_match
0.602	0.128	0.212	entity_match
0.586	0.257	0.357	mention_ceaf
0.456	0.200	0.278	typed_mention_ceaf
0.391	0.171	0.238	typed_mention_ceaf_plus

ONLY English documents:
Prec	Recall	F1	Metric
0.968	0.894	0.930	strong_mention_match
0.616	0.569	0.591	strong_typed_mention_match
0.462	0.427	0.444	strong_typed_all_match
0.681	0.332	0.446	strong_typed_link_match
0.329	0.666	0.441	strong_typed_nil_match
0.602	0.285	0.387	entity_match
0.000	0.000	0.000	mention_ceaf
0.456	0.422	0.438	typed_mention_ceaf
0.391	0.361	0.375	typed_mention_ceaf_plus

ONLY Chinese documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus

ONLY Spanish documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus


*************************************************************

Run ID:  GWU3
Did the run access the live Web during the evaluation window:  No
Did the run use the Wikipedia links in the Reference KB: No
Did the run use the relation/slot information encoded in the Reference KB: Yes
Did the run use the text descriptions in the nodes of the Reference KB: Yes

ALL English, Chinese, and Spanish documents:
Prec	Recall	F1	Metric
0.968	0.424	0.589	strong_mention_match
0.616	0.270	0.375	strong_typed_mention_match
0.462	0.202	0.281	strong_typed_all_match
0.681	0.152	0.249	strong_typed_link_match
0.329	0.345	0.337	strong_typed_nil_match
0.602	0.128	0.212	entity_match
0.558	0.245	0.340	mention_ceaf
0.441	0.193	0.269	typed_mention_ceaf
0.380	0.166	0.231	typed_mention_ceaf_plus

ONLY English documents:
Prec	Recall	F1	Metric
0.968	0.894	0.930	strong_mention_match
0.616	0.569	0.591	strong_typed_mention_match
0.462	0.427	0.444	strong_typed_all_match
0.681	0.332	0.446	strong_typed_link_match
0.329	0.666	0.441	strong_typed_nil_match
0.602	0.285	0.387	entity_match
0.000	0.000	0.000	mention_ceaf
0.441	0.408	0.424	typed_mention_ceaf
0.380	0.351	0.365	typed_mention_ceaf_plus

ONLY Chinese documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus

ONLY Spanish documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus


*************************************************************

Run ID:  GWU4
Did the run access the live Web during the evaluation window:  No
Did the run use the Wikipedia links in the Reference KB: No
Did the run use the relation/slot information encoded in the Reference KB: Yes
Did the run use the text descriptions in the nodes of the Reference KB: Yes

ALL English, Chinese, and Spanish documents:
Prec	Recall	F1	Metric
0.968	0.424	0.589	strong_mention_match
0.616	0.270	0.375	strong_typed_mention_match
0.462	0.202	0.281	strong_typed_all_match
0.681	0.152	0.249	strong_typed_link_match
0.329	0.345	0.337	strong_typed_nil_match
0.602	0.128	0.212	entity_match
0.533	0.233	0.324	mention_ceaf
0.424	0.186	0.258	typed_mention_ceaf
0.368	0.161	0.224	typed_mention_ceaf_plus

ONLY English documents:
Prec	Recall	F1	Metric
0.968	0.894	0.930	strong_mention_match
0.616	0.569	0.591	strong_typed_mention_match
0.462	0.427	0.444	strong_typed_all_match
0.681	0.332	0.446	strong_typed_link_match
0.329	0.666	0.441	strong_typed_nil_match
0.602	0.285	0.387	entity_match
0.000	0.000	0.000	mention_ceaf
0.424	0.392	0.408	typed_mention_ceaf
0.368	0.340	0.354	typed_mention_ceaf_plus

ONLY Chinese documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus

ONLY Spanish documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus


*************************************************************

Run ID:  GWU5
Did the run access the live Web during the evaluation window:  No
Did the run use the Wikipedia links in the Reference KB: No
Did the run use the relation/slot information encoded in the Reference KB: Yes
Did the run use the text descriptions in the nodes of the Reference KB: Yes

ALL English, Chinese, and Spanish documents:
Prec	Recall	F1	Metric
0.968	0.424	0.589	strong_mention_match
0.616	0.270	0.375	strong_typed_mention_match
0.462	0.202	0.281	strong_typed_all_match
0.681	0.152	0.249	strong_typed_link_match
0.329	0.345	0.337	strong_typed_nil_match
0.602	0.128	0.212	entity_match
0.600	0.263	0.366	mention_ceaf
0.463	0.203	0.282	typed_mention_ceaf
0.399	0.175	0.243	typed_mention_ceaf_plus

ONLY English documents:
Prec	Recall	F1	Metric
0.968	0.894	0.930	strong_mention_match
0.616	0.569	0.591	strong_typed_mention_match
0.462	0.427	0.444	strong_typed_all_match
0.681	0.332	0.446	strong_typed_link_match
0.329	0.666	0.441	strong_typed_nil_match
0.602	0.285	0.387	entity_match
0.600	0.555	0.577	mention_ceaf
0.463	0.428	0.445	typed_mention_ceaf
0.399	0.369	0.383	typed_mention_ceaf_plus

ONLY Chinese documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus

ONLY Spanish documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.000	0.000	0.000	mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf
0.000	0.000	0.000	typed_mention_ceaf_plus