============================================================
TAC KBP 2019 ENTITY DISCOVERY AND LINKING EVALUATION RESULTS
============================================================

Team ID:  ibm_mnlp_ie
Organization:  IBM Research

============================================================
Evaluation Window 1
============================================================

Run ID: ibm_mnlp_ie_1 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? Yes

Prec    Recall  F1      Metric
0.540	0.517	0.528	strong_typed_mention_match
*********************

============================================================
Evaluation Window 2: Using Feedback from Window 1
============================================================

Run ID: ibm_mnlp_ie_1 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? Yes
Used Feedback from these runs from Evaluation Window 1: 

Prec    Recall  F1      Metric
0.602	0.626	0.614	strong_typed_mention_match
*********************

Run ID: ibm_mnlp_ie_2 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? Yes
Used Feedback from these runs from Evaluation Window 1: Run_1

Prec    Recall  F1      Metric
0.591	0.615	0.603	strong_typed_mention_match
*********************

Run ID: ibm_mnlp_ie_3 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? Yes
Used Feedback from these runs from Evaluation Window 1: Run_1

Prec    Recall  F1      Metric
0.602	0.627	0.614	strong_typed_mention_match
*********************