====================================================
TAC KBP 2016 ENGLISH SLOT FILLING EVALUATION RESULTS
====================================================


Team ID:  DCD_SF
Organization:  Zhejiang University


*************************************************************

Run ID:  DCD_SF_SF_ENG_1
Did the run access the live Web during the evaluation window:  No
Did the run extract relations from the Cold Start source corpus: Yes
Did the run generate meaningful confidence values: Yes

Slot Filling Evaluation:

Metric                   RunID           Hop Prec   Recall F1    
SF-ALL-Micro             DCD_SF_SF_ENG_1 0   0.0949 0.0599 0.0735
SF-ALL-Micro             DCD_SF_SF_ENG_1 1   0.0194 0.0147 0.0167
SF-ALL-Micro             DCD_SF_SF_ENG_1 ALL 0.0662 0.0447 0.0533
SF-ALL-Macro             DCD_SF_SF_ENG_1 0   0.1011 0.0819 0.0835
SF-ALL-Macro             DCD_SF_SF_ENG_1 1   0.0211 0.0253 0.0222
SF-ALL-Macro             DCD_SF_SF_ENG_1 ALL 0.0707 0.0604 0.0602
LDC-MAX-ALL-Micro        DCD_SF_SF_ENG_1 0   0.1090 0.0670 0.0830
LDC-MAX-ALL-Micro        DCD_SF_SF_ENG_1 1   0.0216 0.0162 0.0186
LDC-MAX-ALL-Micro        DCD_SF_SF_ENG_1 ALL 0.0758 0.0500 0.0602
LDC-MAX-ALL-Macro        DCD_SF_SF_ENG_1 0   0.1189 0.0915 0.0950
LDC-MAX-ALL-Macro        DCD_SF_SF_ENG_1 1   0.0250 0.0272 0.0253
LDC-MAX-ALL-Macro        DCD_SF_SF_ENG_1 ALL 0.0820 0.0662 0.0676
LDC-MEAN-ALL-Macro       DCD_SF_SF_ENG_1 0   0.1142 0.0897 0.0921
LDC-MEAN-ALL-Macro       DCD_SF_SF_ENG_1 1   0.0250 0.0272 0.0253
LDC-MEAN-ALL-Macro       DCD_SF_SF_ENG_1 ALL 0.0792 0.0651 0.0659

*ALL-Macro Prec, Recall and F1 refer to mean-precision, mean-recall and mean-F1.

NIL-DETECTION P/R/F1:				0.0427 0.0976 0.0594


*************************************************************

Run ID:  DCD_SF_SF_ENG_2
Did the run access the live Web during the evaluation window:  No
Did the run extract relations from the Cold Start source corpus: Yes
Did the run generate meaningful confidence values: Yes

Slot Filling Evaluation:

Metric                   RunID           Hop Prec   Recall F1    
SF-ALL-Micro             DCD_SF_SF_ENG_2 0   0.1037 0.0737 0.0861
SF-ALL-Micro             DCD_SF_SF_ENG_2 1   0.0169 0.0147 0.0157
SF-ALL-Micro             DCD_SF_SF_ENG_2 ALL 0.0703 0.0538 0.0609
SF-ALL-Macro             DCD_SF_SF_ENG_2 0   0.1070 0.0918 0.0916
SF-ALL-Macro             DCD_SF_SF_ENG_2 1   0.0261 0.0178 0.0205
SF-ALL-Macro             DCD_SF_SF_ENG_2 ALL 0.0762 0.0637 0.0646
LDC-MAX-ALL-Micro        DCD_SF_SF_ENG_2 0   0.1217 0.0833 0.0989
LDC-MAX-ALL-Micro        DCD_SF_SF_ENG_2 1   0.0192 0.0162 0.0176
LDC-MAX-ALL-Micro        DCD_SF_SF_ENG_2 ALL 0.0824 0.0609 0.0700
LDC-MAX-ALL-Macro        DCD_SF_SF_ENG_2 0   0.1351 0.1138 0.1154
LDC-MAX-ALL-Macro        DCD_SF_SF_ENG_2 1   0.0283 0.0206 0.0231
LDC-MAX-ALL-Macro        DCD_SF_SF_ENG_2 ALL 0.0932 0.0772 0.0791
LDC-MEAN-ALL-Macro       DCD_SF_SF_ENG_2 0   0.1257 0.1073 0.1082
LDC-MEAN-ALL-Macro       DCD_SF_SF_ENG_2 1   0.0283 0.0206 0.0231
LDC-MEAN-ALL-Macro       DCD_SF_SF_ENG_2 ALL 0.0875 0.0733 0.0747

*ALL-Macro Prec, Recall and F1 refer to mean-precision, mean-recall and mean-F1.

NIL-DETECTION P/R/F1:				0.0528 0.1220 0.0737