=============================================================================== TAC KBP 2016 ENTITY DISCOVERY AND LINKING EVALUATION RESULTS (FIRST EDL WINDOW) =============================================================================== Team ID: WednesdayGo Organization: College of Computer Science, Zhengjiang University ************************************************************* Run ID: WednesdayGo1 Did the run access the live Web during the evaluation window: No Did the run use the Wikipedia links in the Reference KB: Yes Did the run use the relation/slot information encoded in the Reference KB: Yes Did the run use the text descriptions in the nodes of the Reference KB: No ALL English, Chinese, and Spanish documents: Prec Recall F1 Metric 0.777 0.247 0.375 strong_typed_mention_match 0.702 0.223 0.339 strong_typed_all_match 0.741 0.222 0.342 strong_typed_link_match 0.595 0.227 0.329 strong_typed_nil_match 0.731 0.251 0.374 entity_match 0.728 0.232 0.352 mention_ceaf 0.706 0.225 0.341 typed_mention_ceaf 0.680 0.217 0.328 typed_mention_ceaf_plus 0.730 0.132 0.224 b_cubed 0.656 0.122 0.205 b_cubed_plus ONLY English documents: Prec Recall F1 Metric 0.816 0.704 0.756 strong_mention_match 0.777 0.671 0.720 strong_typed_mention_match 0.702 0.606 0.651 strong_typed_all_match 0.741 0.601 0.664 strong_typed_link_match 0.595 0.625 0.610 strong_typed_nil_match 0.731 0.671 0.700 entity_match 0.728 0.629 0.675 mention_ceaf 0.706 0.609 0.654 typed_mention_ceaf 0.680 0.587 0.630 typed_mention_ceaf_plus 0.730 0.528 0.612 b_cubed 0.656 0.495 0.564 b_cubed_plus ONLY Chinese documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus 0.000 0.000 0.000 b_cubed 0.000 0.000 0.000 b_cubed_plus ONLY Spanish documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus 0.000 0.000 0.000 b_cubed 0.000 0.000 0.000 b_cubed_plus ************************************************************* Run ID: WednesdayGo2 Did the run access the live Web during the evaluation window: No Did the run use the Wikipedia links in the Reference KB: Yes Did the run use the relation/slot information encoded in the Reference KB: Yes Did the run use the text descriptions in the nodes of the Reference KB: No ALL English, Chinese, and Spanish documents: Prec Recall F1 Metric 0.832 0.252 0.387 strong_typed_mention_match 0.756 0.229 0.352 strong_typed_all_match 0.781 0.230 0.356 strong_typed_link_match 0.679 0.225 0.338 strong_typed_nil_match 0.797 0.258 0.390 entity_match 0.788 0.239 0.366 mention_ceaf 0.759 0.230 0.353 typed_mention_ceaf 0.733 0.222 0.341 typed_mention_ceaf_plus 0.786 0.138 0.235 b_cubed 0.710 0.127 0.216 b_cubed_plus ONLY English documents: Prec Recall F1 Metric 0.879 0.722 0.793 strong_mention_match 0.832 0.684 0.750 strong_typed_mention_match 0.756 0.622 0.682 strong_typed_all_match 0.781 0.622 0.693 strong_typed_link_match 0.679 0.619 0.648 strong_typed_nil_match 0.797 0.690 0.740 entity_match 0.788 0.647 0.711 mention_ceaf 0.759 0.624 0.685 typed_mention_ceaf 0.733 0.602 0.661 typed_mention_ceaf_plus 0.786 0.554 0.650 b_cubed 0.710 0.520 0.600 b_cubed_plus ONLY Chinese documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus 0.000 0.000 0.000 b_cubed 0.000 0.000 0.000 b_cubed_plus ONLY Spanish documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus 0.000 0.000 0.000 b_cubed 0.000 0.000 0.000 b_cubed_plus ************************************************************* Run ID: WednesdayGo5 Did the run access the live Web during the evaluation window: No Did the run use the Wikipedia links in the Reference KB: Yes Did the run use the relation/slot information encoded in the Reference KB: Yes Did the run use the text descriptions in the nodes of the Reference KB: No ALL English, Chinese, and Spanish documents: Prec Recall F1 Metric 0.829 0.251 0.386 strong_typed_mention_match 0.745 0.226 0.347 strong_typed_all_match 0.767 0.226 0.349 strong_typed_link_match 0.678 0.224 0.337 strong_typed_nil_match 0.797 0.258 0.390 entity_match 0.788 0.239 0.366 mention_ceaf 0.749 0.227 0.348 typed_mention_ceaf 0.722 0.219 0.336 typed_mention_ceaf_plus 0.786 0.138 0.235 b_cubed 0.710 0.127 0.216 b_cubed_plus ONLY English documents: Prec Recall F1 Metric 0.879 0.722 0.793 strong_mention_match 0.829 0.681 0.748 strong_typed_mention_match 0.745 0.613 0.672 strong_typed_all_match 0.767 0.611 0.680 strong_typed_link_match 0.678 0.618 0.647 strong_typed_nil_match 0.797 0.690 0.740 entity_match 0.788 0.647 0.711 mention_ceaf 0.749 0.616 0.676 typed_mention_ceaf 0.722 0.593 0.652 typed_mention_ceaf_plus 0.786 0.554 0.650 b_cubed 0.710 0.520 0.600 b_cubed_plus ONLY Chinese documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus 0.000 0.000 0.000 b_cubed 0.000 0.000 0.000 b_cubed_plus ONLY Spanish documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus 0.000 0.000 0.000 b_cubed 0.000 0.000 0.000 b_cubed_plus