==============================================================
TAC KBP 2017 KB CONSTRUCTION: COMPONENT EDL EVALUATION RESULTS
==============================================================


Team ID:  ICTCAS_OKN
Organization:  Institute of Computing Technology, Chinese Academy of Sciences


*************************************************************

Run ID:  ICTCAS_OKN_KB_ENG_1 
See full details of run under Cold Start KB: Composite KB evaluation results

ONLY English documents:
Prec	Recall	F1	Metric
0.909	0.622	0.738	strong_mention_match
0.817	0.559	0.664	strong_typed_mention_match
0.256	0.175	0.208	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.256	0.516	0.342	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.617	0.422	0.501	mention_ceaf
0.567	0.388	0.461	typed_mention_ceaf
0.186	0.127	0.151	typed_mention_ceaf_plus
0.831	0.341	0.483	b_cubed
0.252	0.139	0.179	b_cubed_plus


*************************************************************

Run ID:  ICTCAS_OKN_KB_ENG_2 
See full details of run under Cold Start KB: Composite KB evaluation results

ONLY English documents:
Prec	Recall	F1	Metric
0.913	0.619	0.738	strong_mention_match
0.848	0.575	0.685	strong_typed_mention_match
0.278	0.188	0.224	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.278	0.556	0.370	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.603	0.409	0.488	mention_ceaf
0.565	0.383	0.457	typed_mention_ceaf
0.201	0.136	0.162	typed_mention_ceaf_plus
0.850	0.327	0.472	b_cubed
0.257	0.138	0.180	b_cubed_plus


*************************************************************

Run ID:  ICTCAS_OKN_KB_ENG_3 
See full details of run under Cold Start KB: Composite KB evaluation results

ONLY English documents:
Prec	Recall	F1	Metric
0.908	0.625	0.741	strong_mention_match
0.833	0.573	0.679	strong_typed_mention_match
0.269	0.185	0.219	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.269	0.546	0.360	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.692	0.476	0.564	mention_ceaf
0.644	0.444	0.525	typed_mention_ceaf
0.235	0.162	0.192	typed_mention_ceaf_plus
0.827	0.395	0.535	b_cubed
0.252	0.170	0.203	b_cubed_plus


*************************************************************

Run ID:  ICTCAS_OKN_KB_ENG_4 
See full details of run under Cold Start KB: Composite KB evaluation results

ONLY English documents:
Prec	Recall	F1	Metric
0.913	0.619	0.738	strong_mention_match
0.848	0.575	0.685	strong_typed_mention_match
0.278	0.188	0.224	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.278	0.556	0.370	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.603	0.409	0.488	mention_ceaf
0.565	0.383	0.457	typed_mention_ceaf
0.201	0.136	0.162	typed_mention_ceaf_plus
0.850	0.327	0.472	b_cubed
0.257	0.138	0.180	b_cubed_plus


*************************************************************

Run ID:  ICTCAS_OKN_KB_ENG_5 
See full details of run under Cold Start KB: Composite KB evaluation results

ONLY English documents:
Prec	Recall	F1	Metric
0.913	0.619	0.738	strong_mention_match
0.848	0.575	0.685	strong_typed_mention_match
0.278	0.188	0.224	strong_typed_all_match
0.000	0.000	0.000	strong_typed_link_match
0.278	0.556	0.370	strong_typed_nil_match
0.000	0.000	0.000	entity_match
0.603	0.409	0.488	mention_ceaf
0.565	0.383	0.457	typed_mention_ceaf
0.201	0.136	0.162	typed_mention_ceaf_plus
0.850	0.327	0.472	b_cubed
0.257	0.138	0.180	b_cubed_plus