=========================================================== TAC KBP 2015 COLD START ENTITY DISCOVERY EVALUATION RESULTS =========================================================== Team ID: lodie Organization: University of Sheffield ************************************************************* Run ID: lodie1 Did the run access the live Web during the evaluation window: No Entity Discovery Evaluation: Prec Recall F1 Metric 0.775 0.795 0.785 strong_mention_match 0.714 0.732 0.723 strong_typed_mention_match 0.000 0.000 0.000 entity_match 0.710 0.556 0.624 b_cubed 0.624 0.640 0.632 mention_ceaf 0.581 0.596 0.588 typed_mention_ceaf 0.581 0.596 0.588 typed_mention_ceaf_plus ************************************************************* Run ID: lodie2 Did the run access the live Web during the evaluation window: No Entity Discovery Evaluation: Prec Recall F1 Metric 0.775 0.795 0.785 strong_mention_match 0.714 0.732 0.723 strong_typed_mention_match 0.000 0.000 0.000 entity_match 0.697 0.559 0.620 b_cubed 0.621 0.637 0.629 mention_ceaf 0.577 0.592 0.585 typed_mention_ceaf 0.577 0.592 0.585 typed_mention_ceaf_plus ************************************************************* Run ID: lodie3 Did the run access the live Web during the evaluation window: No Entity Discovery Evaluation: Prec Recall F1 Metric 0.775 0.795 0.785 strong_mention_match 0.714 0.732 0.723 strong_typed_mention_match 0.000 0.000 0.000 entity_match 0.710 0.557 0.624 b_cubed 0.624 0.640 0.632 mention_ceaf 0.581 0.596 0.588 typed_mention_ceaf 0.581 0.596 0.588 typed_mention_ceaf_plus ************************************************************* Run ID: lodie4 Did the run access the live Web during the evaluation window: No Entity Discovery Evaluation: Prec Recall F1 Metric 0.775 0.795 0.785 strong_mention_match 0.714 0.732 0.723 strong_typed_mention_match 0.000 0.000 0.000 entity_match 0.709 0.557 0.624 b_cubed 0.624 0.640 0.632 mention_ceaf 0.581 0.596 0.588 typed_mention_ceaf 0.581 0.596 0.588 typed_mention_ceaf_plus ************************************************************* Run ID: lodie5 Did the run access the live Web during the evaluation window: No Entity Discovery Evaluation: Prec Recall F1 Metric 0.775 0.795 0.785 strong_mention_match 0.714 0.732 0.723 strong_typed_mention_match 0.000 0.000 0.000 entity_match 0.709 0.557 0.624 b_cubed 0.624 0.640 0.632 mention_ceaf 0.581 0.596 0.588 typed_mention_ceaf 0.581 0.596 0.588 typed_mention_ceaf_plus