======================================================================= TAC KBP 2015 TRILINGUAL ENTITY DISCOVERY AND LINKING EVALUATION RESULTS ======================================================================= Team ID: UI_CCG Organization: University of Illinois at Urbana Champaign ************************************************************* Run ID: UI_CCG1 Did the run access the live Web during the evaluation window: Yes Did the run use the Wikipedia links in the Reference KB: Yes Did the run use the relation/slot information encoded in the Reference KB: No Did the run use the text descriptions in the nodes of the Reference KB: No ALL English, Chinese, and Spanish documents: Prec Recall F1 Metric 0.801 0.140 0.239 strong_mention_match 0.761 0.133 0.227 strong_typed_mention_match 0.705 0.123 0.210 strong_typed_all_match 0.681 0.115 0.197 strong_typed_link_match 0.763 0.146 0.245 strong_typed_nil_match 0.730 0.176 0.284 entity_match 0.750 0.131 0.224 mention_ceaf 0.722 0.126 0.215 typed_mention_ceaf 0.699 0.122 0.208 typed_mention_ceaf_plus ONLY English documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus ONLY Chinese documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus ONLY Spanish documents: Prec Recall F1 Metric 0.801 0.772 0.787 strong_mention_match 0.761 0.734 0.747 strong_typed_mention_match 0.705 0.679 0.692 strong_typed_all_match 0.681 0.653 0.667 strong_typed_link_match 0.763 0.748 0.756 strong_typed_nil_match 0.730 0.740 0.735 entity_match 0.750 0.723 0.737 mention_ceaf 0.722 0.696 0.709 typed_mention_ceaf 0.699 0.674 0.686 typed_mention_ceaf_plus ************************************************************* Run ID: UI_CCG2 Did the run access the live Web during the evaluation window: Yes Did the run use the Wikipedia links in the Reference KB: Yes Did the run use the relation/slot information encoded in the Reference KB: No Did the run use the text descriptions in the nodes of the Reference KB: No ALL English, Chinese, and Spanish documents: Prec Recall F1 Metric 0.796 0.140 0.238 strong_mention_match 0.755 0.133 0.226 strong_typed_mention_match 0.699 0.123 0.209 strong_typed_all_match 0.674 0.115 0.196 strong_typed_link_match 0.763 0.146 0.245 strong_typed_nil_match 0.724 0.176 0.284 entity_match 0.746 0.131 0.223 mention_ceaf 0.716 0.126 0.214 typed_mention_ceaf 0.693 0.122 0.208 typed_mention_ceaf_plus ONLY English documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus ONLY Chinese documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus ONLY Spanish documents: Prec Recall F1 Metric 0.796 0.772 0.784 strong_mention_match 0.755 0.732 0.743 strong_typed_mention_match 0.699 0.678 0.688 strong_typed_all_match 0.674 0.650 0.662 strong_typed_link_match 0.763 0.748 0.756 strong_typed_nil_match 0.724 0.740 0.732 entity_match 0.746 0.723 0.734 mention_ceaf 0.716 0.694 0.705 typed_mention_ceaf 0.693 0.672 0.682 typed_mention_ceaf_plus ************************************************************* Run ID: UI_CCG3 Did the run access the live Web during the evaluation window: Yes Did the run use the Wikipedia links in the Reference KB: Yes Did the run use the relation/slot information encoded in the Reference KB: No Did the run use the text descriptions in the nodes of the Reference KB: No ALL English, Chinese, and Spanish documents: Prec Recall F1 Metric 0.797 0.140 0.239 strong_mention_match 0.757 0.133 0.227 strong_typed_mention_match 0.699 0.123 0.209 strong_typed_all_match 0.671 0.115 0.196 strong_typed_link_match 0.768 0.146 0.245 strong_typed_nil_match 0.727 0.174 0.281 entity_match 0.746 0.131 0.223 mention_ceaf 0.717 0.126 0.215 typed_mention_ceaf 0.693 0.122 0.207 typed_mention_ceaf_plus ONLY English documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus ONLY Chinese documents: Prec Recall F1 Metric 0.000 0.000 0.000 strong_mention_match 0.000 0.000 0.000 strong_typed_mention_match 0.000 0.000 0.000 strong_typed_all_match 0.000 0.000 0.000 strong_typed_link_match 0.000 0.000 0.000 strong_typed_nil_match 0.000 0.000 0.000 entity_match 0.000 0.000 0.000 mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf 0.000 0.000 0.000 typed_mention_ceaf_plus ONLY Spanish documents: Prec Recall F1 Metric 0.797 0.772 0.784 strong_mention_match 0.757 0.734 0.745 strong_typed_mention_match 0.699 0.677 0.688 strong_typed_all_match 0.671 0.650 0.661 strong_typed_link_match 0.768 0.746 0.757 strong_typed_nil_match 0.727 0.732 0.729 entity_match 0.746 0.723 0.734 mention_ceaf 0.717 0.695 0.705 typed_mention_ceaf 0.693 0.671 0.682 typed_mention_ceaf_plus