============================================================
TAC KBP 2019 ENTITY DISCOVERY AND LINKING EVALUATION RESULTS
============================================================

Team ID:  ousia
Organization:  Octanove Labs LLC; Studio Ousia Inc.

============================================================
Evaluation Window 1
============================================================

Run ID: ousia_1 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? No

Prec    Recall  F1      Metric
0.484	0.441	0.462	strong_typed_mention_match
*********************

Run ID: ousia_2 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? No

Prec    Recall  F1      Metric
0.487	0.453	0.469	strong_typed_mention_match
*********************

Run ID: ousia_3 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? No

Prec    Recall  F1      Metric
0.504	0.468	0.485	strong_typed_mention_match
*********************

============================================================
Evaluation Window 2: Using Feedback from Window 1
============================================================

Run ID: ousia_1 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? No
Used Feedback from these runs from Evaluation Window 1: Run_1

Prec    Recall  F1      Metric
0.483	0.461	0.472	strong_typed_mention_match
*********************

Run ID: ousia_2 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? No
Used Feedback from these runs from Evaluation Window 1: Run_2

Prec    Recall  F1      Metric
0.506	0.493	0.499	strong_typed_mention_match
*********************

Run ID: ousia_3 
Did the run access the Web during the evaluation? No
Did the run produce meaningful confidence values? No
Used Feedback from these runs from Evaluation Window 1: Run_3

Prec    Recall  F1      Metric
0.471	0.481	0.476	strong_typed_mention_match
*********************