===================================================================================
TAC KBP 2017 LOW RESOURCE LANGUAGES ENTITY DISCOVERY AND LINKING EVALUATION RESULTS
===================================================================================


Team ID:  hltcoe
Organization:  Human Language Technology Center of Excellence


*************************************************************

Run ID:  hltcoe1
Languages addressed: Polish, Albanian, Swahili, Kannada, Nepali
Did the run access the live Web during the evaluation window:  No
Did the run use the relation/slot information encoded in the Reference KB: No
Did the run use the text descriptions in the nodes of the Reference KB: No

ALL languge documents:
Prec	Recall	F1	Metric
0.820	0.179	0.294	strong_mention_match
0.739	0.162	0.265	strong_typed_mention_match
0.582	0.127	0.209	strong_typed_all_match
0.686	0.144	0.238	strong_typed_link_match
0.107	0.029	0.046	strong_typed_nil_match
0.615	0.251	0.356	entity_match

ONLY Albanian documents:
Prec	Recall	F1	Metric
0.892	0.805	0.846	strong_mention_match
0.800	0.722	0.759	strong_typed_mention_match
0.601	0.542	0.570	strong_typed_all_match
0.687	0.545	0.608	strong_typed_link_match
0.059	0.385	0.102	strong_typed_nil_match
0.634	0.667	0.650	entity_match

ONLY Chechen documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match

ONLY Kannada documents:
Prec	Recall	F1	Metric
0.753	0.567	0.647	strong_mention_match
0.679	0.512	0.584	strong_typed_mention_match
0.463	0.349	0.398	strong_typed_all_match
0.694	0.383	0.493	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.702	0.423	0.528	entity_match

ONLY Kikuyu documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match

ONLY Nepali documents:
Prec	Recall	F1	Metric
0.752	0.590	0.661	strong_mention_match
0.739	0.580	0.650	strong_typed_mention_match
0.578	0.454	0.508	strong_typed_all_match
0.688	0.467	0.557	strong_typed_link_match
0.194	0.333	0.246	strong_typed_nil_match
0.610	0.571	0.590	entity_match

ONLY Northern Sotho documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match

ONLY Polish documents:
Prec	Recall	F1	Metric
0.707	0.638	0.670	strong_mention_match
0.587	0.530	0.557	strong_typed_mention_match
0.421	0.380	0.399	strong_typed_all_match
0.557	0.386	0.456	strong_typed_link_match
0.030	0.200	0.052	strong_typed_nil_match
0.519	0.611	0.561	entity_match

ONLY Somali documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match

ONLY Swahili documents:
Prec	Recall	F1	Metric
0.831	0.800	0.815	strong_mention_match
0.756	0.728	0.742	strong_typed_mention_match
0.665	0.641	0.653	strong_typed_all_match
0.732	0.642	0.684	strong_typed_link_match
0.250	0.618	0.356	strong_typed_nil_match
0.632	0.672	0.652	entity_match

ONLY Yoruba documents:
Prec	Recall	F1	Metric
0.000	0.000	0.000	strong_mention_match
0.000	0.000	0.000	strong_typed_mention_match
0.000	0.000	0.000	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.000	0.000	0.000	entity_match