===================================================================================
TAC KBP 2017 LOW RESOURCE LANGUAGES ENTITY DISCOVERY AND LINKING EVALUATION RESULTS
===================================================================================


Team ID:  RPI_BLENDER
Organization:  Rensselaer Polytechnic Institute


*************************************************************

Run ID:  RPI_BLENDER1
Languages addressed: Polish, Chechen, Albanian, Swahili, Kannada, Yoruba, Northern Sotho, Nepali, Kikuyu, Somali
Did the run access the live Web during the evaluation window:  No
Did the run use the relation/slot information encoded in the Reference KB: No
Did the run use the text descriptions in the nodes of the Reference KB: No

ALL languge documents:
Prec	Recall	F1	Metric
0.842	0.739	0.787	strong_mention_match
0.801	0.702	0.748	strong_typed_mention_match
0.705	0.619	0.659	strong_typed_all_match
0.801	0.656	0.721	strong_typed_link_match
0.328	0.400	0.360	strong_typed_nil_match
0.629	0.539	0.581	entity_match

ONLY Albanian documents:
Prec	Recall	F1	Metric
0.843	0.770	0.805	strong_mention_match
0.781	0.714	0.746	strong_typed_mention_match
0.590	0.539	0.563	strong_typed_all_match
0.718	0.542	0.618	strong_typed_link_match
0.042	0.385	0.076	strong_typed_nil_match
0.680	0.645	0.662	entity_match

ONLY Chechen documents:
Prec	Recall	F1	Metric
0.638	0.514	0.570	strong_mention_match
0.621	0.501	0.554	strong_typed_mention_match
0.589	0.475	0.526	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.625	0.475	0.540	strong_typed_nil_match
0.000	0.000	0.000	entity_match

ONLY Kannada documents:
Prec	Recall	F1	Metric
0.791	0.563	0.658	strong_mention_match
0.673	0.479	0.560	strong_typed_mention_match
0.529	0.377	0.440	strong_typed_all_match
0.696	0.398	0.506	strong_typed_link_match
0.073	0.158	0.100	strong_typed_nil_match
0.691	0.487	0.571	entity_match

ONLY Kikuyu documents:
Prec	Recall	F1	Metric
0.939	0.843	0.888	strong_mention_match
0.938	0.842	0.887	strong_typed_mention_match
0.938	0.842	0.887	strong_typed_all_match
0.966	0.842	0.900	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.759	0.352	0.481	entity_match

ONLY Nepali documents:
Prec	Recall	F1	Metric
0.596	0.424	0.496	strong_mention_match
0.527	0.376	0.439	strong_typed_mention_match
0.418	0.298	0.348	strong_typed_all_match
0.770	0.310	0.442	strong_typed_link_match
0.056	0.190	0.086	strong_typed_nil_match
0.750	0.381	0.505	entity_match

ONLY Northern Sotho documents:
Prec	Recall	F1	Metric
0.906	0.913	0.910	strong_mention_match
0.904	0.912	0.908	strong_typed_mention_match
0.851	0.858	0.855	strong_typed_all_match
0.957	0.858	0.905	strong_typed_link_match
0.000	0.000	0.000	strong_typed_nil_match
0.813	0.554	0.659	entity_match

ONLY Polish documents:
Prec	Recall	F1	Metric
0.758	0.512	0.611	strong_mention_match
0.660	0.446	0.532	strong_typed_mention_match
0.562	0.380	0.453	strong_typed_all_match
0.616	0.383	0.472	strong_typed_link_match
0.136	0.300	0.187	strong_typed_nil_match
0.584	0.584	0.584	entity_match

ONLY Somali documents:
Prec	Recall	F1	Metric
0.815	0.782	0.798	strong_mention_match
0.802	0.769	0.785	strong_typed_mention_match
0.573	0.549	0.560	strong_typed_all_match
0.653	0.574	0.611	strong_typed_link_match
0.364	0.457	0.405	strong_typed_nil_match
0.655	0.599	0.626	entity_match

ONLY Swahili documents:
Prec	Recall	F1	Metric
0.842	0.682	0.754	strong_mention_match
0.757	0.613	0.678	strong_typed_mention_match
0.671	0.543	0.600	strong_typed_all_match
0.738	0.552	0.632	strong_typed_link_match
0.203	0.382	0.265	strong_typed_nil_match
0.658	0.566	0.609	entity_match

ONLY Yoruba documents:
Prec	Recall	F1	Metric
0.769	0.540	0.634	strong_mention_match
0.600	0.421	0.495	strong_typed_mention_match
0.432	0.303	0.356	strong_typed_all_match
0.422	0.324	0.367	strong_typed_link_match
0.488	0.227	0.310	strong_typed_nil_match
0.509	0.488	0.498	entity_match