================================================================================ TAC KBP 2016 ENTITY DISCOVERY AND LINKING EVALUATION RESULTS (SECOND EDL WINDOW) ================================================================================ Team ID: WednesdayGo Organization: College of Computer Science, Zhengjiang University ************************************************************* Run ID: WednesdayGo1 Did the run access the live Web during the evaluation window: No Did the run use the Wikipedia links in the Reference KB: Yes Did the run use the relation/slot information encoded in the Reference KB: Yes Did the run use the text descriptions in the nodes of the Reference KB: No Did the run use any of the distributed EDL1 runs (from the first evaluation window): No ALL English, Chinese, and Spanish documents: Prec Recall F1 Metric 0.832 0.252 0.387 strong_typed_mention_match 0.756 0.229 0.352 strong_typed_all_match 0.781 0.230 0.356 strong_typed_link_match 0.679 0.224 0.337 strong_typed_nil_match 0.797 0.258 0.390 entity_match 0.788 0.239 0.366 mention_ceaf 0.759 0.230 0.353 typed_mention_ceaf 0.733 0.222 0.341 typed_mention_ceaf_plus 0.787 0.138 0.235 b_cubed 0.710 0.127 0.216 b_cubed_plus ONLY English documents: Prec Recall F1 Metric 0.879 0.722 0.793 strong_mention_match 0.832 0.683 0.750 strong_typed_mention_match 0.756 0.621 0.682 strong_typed_all_match 0.781 0.622 0.693 strong_typed_link_match 0.679 0.618 0.647 strong_typed_nil_match 0.797 0.690 0.740 entity_match 0.788 0.647 0.711 mention_ceaf 0.759 0.623 0.684 typed_mention_ceaf 0.733 0.602 0.661 typed_mention_ceaf_plus 0.787 0.554 0.650 b_cubed 0.710 0.520 0.600 b_cubed_plus ONLY Chinese documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus 0.000 0.000 0.000 b_cubed 0.000 0.000 0.000 b_cubed_plus ONLY Spanish documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus 0.000 0.000 0.000 b_cubed 0.000 0.000 0.000 b_cubed_plus ************************************************************* Run ID: WednesdayGo2 Did the run access the live Web during the evaluation window: No Did the run use the Wikipedia links in the Reference KB: Yes Did the run use the relation/slot information encoded in the Reference KB: Yes Did the run use the text descriptions in the nodes of the Reference KB: No Did the run use any of the distributed EDL1 runs (from the first evaluation window): No ALL English, Chinese, and Spanish documents: Prec Recall F1 Metric 0.784 0.249 0.378 strong_typed_mention_match 0.709 0.225 0.341 strong_typed_all_match 0.747 0.224 0.345 strong_typed_link_match 0.603 0.227 0.330 strong_typed_nil_match 0.735 0.252 0.375 entity_match 0.735 0.233 0.354 mention_ceaf 0.712 0.226 0.343 typed_mention_ceaf 0.687 0.218 0.331 typed_mention_ceaf_plus 0.738 0.133 0.225 b_cubed 0.665 0.122 0.207 b_cubed_plus ONLY English documents: Prec Recall F1 Metric 0.822 0.707 0.761 strong_mention_match 0.784 0.675 0.725 strong_typed_mention_match 0.709 0.609 0.655 strong_typed_all_match 0.747 0.605 0.668 strong_typed_link_match 0.603 0.625 0.614 strong_typed_nil_match 0.735 0.673 0.703 entity_match 0.735 0.632 0.679 mention_ceaf 0.712 0.613 0.659 typed_mention_ceaf 0.687 0.590 0.635 typed_mention_ceaf_plus 0.738 0.532 0.618 b_cubed 0.665 0.499 0.570 b_cubed_plus ONLY Chinese documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus 0.000 0.000 0.000 b_cubed 0.000 0.000 0.000 b_cubed_plus ONLY Spanish documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus 0.000 0.000 0.000 b_cubed 0.000 0.000 0.000 b_cubed_plus ************************************************************* Run ID: WednesdayGo3 Did the run access the live Web during the evaluation window: No Did the run use the Wikipedia links in the Reference KB: Yes Did the run use the relation/slot information encoded in the Reference KB: Yes Did the run use the text descriptions in the nodes of the Reference KB: No Did the run use any of the distributed EDL1 runs (from the first evaluation window): No ALL English, Chinese, and Spanish documents: Prec Recall F1 Metric 0.829 0.251 0.386 strong_typed_mention_match 0.746 0.226 0.347 strong_typed_all_match 0.767 0.226 0.349 strong_typed_link_match 0.679 0.224 0.337 strong_typed_nil_match 0.797 0.258 0.390 entity_match 0.788 0.239 0.366 mention_ceaf 0.750 0.227 0.348 typed_mention_ceaf 0.722 0.219 0.336 typed_mention_ceaf_plus 0.787 0.138 0.235 b_cubed 0.710 0.127 0.216 b_cubed_plus ONLY English documents: Prec Recall F1 Metric 0.879 0.722 0.793 strong_mention_match 0.829 0.681 0.748 strong_typed_mention_match 0.746 0.613 0.673 strong_typed_all_match 0.767 0.611 0.680 strong_typed_link_match 0.679 0.618 0.647 strong_typed_nil_match 0.797 0.690 0.740 entity_match 0.788 0.647 0.711 mention_ceaf 0.750 0.616 0.676 typed_mention_ceaf 0.722 0.593 0.652 typed_mention_ceaf_plus 0.787 0.554 0.650 b_cubed 0.710 0.520 0.600 b_cubed_plus ONLY Chinese documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus 0.000 0.000 0.000 b_cubed 0.000 0.000 0.000 b_cubed_plus ONLY Spanish documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus 0.000 0.000 0.000 b_cubed 0.000 0.000 0.000 b_cubed_plus