================================================================================ TAC KBP 2016 ENTITY DISCOVERY AND LINKING EVALUATION RESULTS (SECOND EDL WINDOW) ================================================================================ Team ID: summa Organization: University College London ************************************************************* Run ID: summa3 Did the run access the live Web during the evaluation window: No Did the run use the Wikipedia links in the Reference KB: Yes Did the run use the relation/slot information encoded in the Reference KB: No Did the run use the text descriptions in the nodes of the Reference KB: No Did the run use any of the distributed EDL1 runs (from the first evaluation window): No ALL English, Chinese, and Spanish documents: Prec Recall F1 Metric 0.811 0.201 0.322 strong_typed_mention_match 0.707 0.175 0.281 strong_typed_all_match 0.721 0.169 0.274 strong_typed_link_match 0.669 0.196 0.303 strong_typed_nil_match 0.757 0.222 0.343 entity_match 0.794 0.197 0.315 mention_ceaf 0.740 0.183 0.294 typed_mention_ceaf 0.694 0.172 0.275 typed_mention_ceaf_plus 0.818 0.103 0.183 b_cubed 0.702 0.092 0.162 b_cubed_plus ONLY English documents: Prec Recall F1 Metric 0.888 0.596 0.714 strong_mention_match 0.811 0.544 0.651 strong_typed_mention_match 0.707 0.475 0.568 strong_typed_all_match 0.721 0.457 0.559 strong_typed_link_match 0.669 0.540 0.597 strong_typed_nil_match 0.757 0.594 0.666 entity_match 0.794 0.533 0.638 mention_ceaf 0.740 0.497 0.594 typed_mention_ceaf 0.694 0.466 0.558 typed_mention_ceaf_plus 0.818 0.414 0.550 b_cubed 0.702 0.376 0.489 b_cubed_plus ONLY Chinese documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus 0.000 0.000 0.000 b_cubed 0.000 0.000 0.000 b_cubed_plus ONLY Spanish documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus 0.000 0.000 0.000 b_cubed 0.000 0.000 0.000 b_cubed_plus