============================================================
TAC KBP 2019 ENTITY DISCOVERY AND LINKING EVALUATION RESULTS
============================================================

Team ID:  RWTH
Organization:  RWTH Aachen University

============================================================
Evaluation Window 1
============================================================

Run ID: RWTH_2 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? Yes

Prec    Recall  F1      Metric
0.325	0.362	0.343	strong_typed_mention_match
*********************

Run ID: RWTH_3 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? Yes

Prec    Recall  F1      Metric
0.465	0.364	0.408	strong_typed_mention_match
*********************

============================================================
Evaluation Window 2: Using Feedback from Window 1
============================================================

Run ID: RWTH_1 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? No
Used Feedback from these runs from Evaluation Window 1: 

Prec    Recall  F1      Metric
0.344	0.440	0.386	strong_typed_mention_match
*********************

Run ID: RWTH_2 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? Yes
Used Feedback from these runs from Evaluation Window 1: 

Prec    Recall  F1      Metric
0.350	0.433	0.387	strong_typed_mention_match
*********************

Run ID: RWTH_3 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? Yes
Used Feedback from these runs from Evaluation Window 1: 

Prec    Recall  F1      Metric
0.350	0.451	0.394	strong_typed_mention_match
*********************