======================================================================= TAC KBP 2015 DIAGNOSTIC TRILINGUAL ENTITY LINKING EVALUATION RESULTS ======================================================================= Team ID: ZJU_DCD_EDL Organization: Zhejiang University-Digital Media Computing & Design Lab ************************************************************* Run ID: ZJU_DCD_EDL1 Did the run access the live Web during the evaluation window: No Did the run use the Wikipedia links in the Reference KB: Yes Did the run use the relation/slot information encoded in the Reference KB: No Did the run use the text descriptions in the nodes of the Reference KB: Yes ALL English, Chinese, and Spanish documents: Prec Recall F1 Metric 0.968 0.424 0.589 strong_mention_match 0.386 0.169 0.235 strong_typed_mention_match 0.272 0.119 0.166 strong_typed_all_match 0.144 0.067 0.092 strong_typed_link_match 0.758 0.267 0.395 strong_typed_nil_match 0.689 0.378 0.488 entity_match 0.831 0.364 0.506 mention_ceaf 0.305 0.133 0.186 typed_mention_ceaf 0.262 0.115 0.160 typed_mention_ceaf_plus ONLY English documents: Prec Recall F1 Metric 0.968 0.894 0.930 strong_mention_match 0.386 0.356 0.370 strong_typed_mention_match 0.272 0.252 0.262 strong_typed_all_match 0.144 0.147 0.145 strong_typed_link_match 0.758 0.515 0.614 strong_typed_nil_match 0.689 0.839 0.757 entity_match 0.831 0.769 0.799 mention_ceaf 0.305 0.282 0.293 typed_mention_ceaf 0.262 0.242 0.252 typed_mention_ceaf_plus ONLY Chinese documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus ONLY Spanish documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus