==================================================== TAC KBP 2016 ENGLISH SLOT FILLING EVALUATION RESULTS ==================================================== Team ID: doughnutPRIS Organization: Beijing University of Posts and Telecommunications ************************************************************* Run ID: doughnutPRIS_SF_ENG_4 Did the run access the live Web during the evaluation window: No Did the run extract relations from the Cold Start source corpus: No Did the run generate meaningful confidence values: No Slot Filling Evaluation: Metric RunID Hop Prec Recall F1 SF-ALL-Micro doughnutPRIS_SF_ENG_4 0 0.1342 0.0637 0.0864 SF-ALL-Micro doughnutPRIS_SF_ENG_4 1 0.0000 0.0000 0.0000 SF-ALL-Micro doughnutPRIS_SF_ENG_4 ALL 0.1342 0.0422 0.0642 SF-ALL-Macro doughnutPRIS_SF_ENG_4 0 0.0986 0.1036 0.0902 SF-ALL-Macro doughnutPRIS_SF_ENG_4 1 0.0000 0.0000 0.0000 SF-ALL-Macro doughnutPRIS_SF_ENG_4 ALL 0.0611 0.0642 0.0559 LDC-MAX-ALL-Micro doughnutPRIS_SF_ENG_4 0 0.1348 0.0588 0.0819 LDC-MAX-ALL-Micro doughnutPRIS_SF_ENG_4 1 0.0000 0.0000 0.0000 LDC-MAX-ALL-Micro doughnutPRIS_SF_ENG_4 ALL 0.1348 0.0391 0.0607 LDC-MAX-ALL-Macro doughnutPRIS_SF_ENG_4 0 0.0963 0.1026 0.0898 LDC-MAX-ALL-Macro doughnutPRIS_SF_ENG_4 1 0.0000 0.0000 0.0000 LDC-MAX-ALL-Macro doughnutPRIS_SF_ENG_4 ALL 0.0585 0.0623 0.0545 LDC-MEAN-ALL-Macro doughnutPRIS_SF_ENG_4 0 0.0884 0.0965 0.0832 LDC-MEAN-ALL-Macro doughnutPRIS_SF_ENG_4 1 0.0000 0.0000 0.0000 LDC-MEAN-ALL-Macro doughnutPRIS_SF_ENG_4 ALL 0.0537 0.0586 0.0505 *ALL-Macro Prec, Recall and F1 refer to mean-precision, mean-recall and mean-F1. NIL-DETECTION P/R/F1: 0.2444 0.7073 0.3633 ************************************************************* Run ID: doughnutPRIS_SF_ENG_5 Did the run access the live Web during the evaluation window: No Did the run extract relations from the Cold Start source corpus: No Did the run generate meaningful confidence values: No Slot Filling Evaluation: Metric RunID Hop Prec Recall F1 SF-ALL-Micro doughnutPRIS_SF_ENG_5 0 0.1279 0.1036 0.1145 SF-ALL-Micro doughnutPRIS_SF_ENG_5 1 0.0000 0.0000 0.0000 SF-ALL-Micro doughnutPRIS_SF_ENG_5 ALL 0.1279 0.0687 0.0893 SF-ALL-Macro doughnutPRIS_SF_ENG_5 0 0.1321 0.1525 0.1301 SF-ALL-Macro doughnutPRIS_SF_ENG_5 1 0.0000 0.0000 0.0000 SF-ALL-Macro doughnutPRIS_SF_ENG_5 ALL 0.0819 0.0946 0.0806 LDC-MAX-ALL-Micro doughnutPRIS_SF_ENG_5 0 0.1293 0.0980 0.1115 LDC-MAX-ALL-Micro doughnutPRIS_SF_ENG_5 1 0.0000 0.0000 0.0000 LDC-MAX-ALL-Micro doughnutPRIS_SF_ENG_5 ALL 0.1293 0.0652 0.0867 LDC-MAX-ALL-Macro doughnutPRIS_SF_ENG_5 0 0.1358 0.1539 0.1318 LDC-MAX-ALL-Macro doughnutPRIS_SF_ENG_5 1 0.0000 0.0000 0.0000 LDC-MAX-ALL-Macro doughnutPRIS_SF_ENG_5 ALL 0.0825 0.0934 0.0800 LDC-MEAN-ALL-Macro doughnutPRIS_SF_ENG_5 0 0.1275 0.1456 0.1242 LDC-MEAN-ALL-Macro doughnutPRIS_SF_ENG_5 1 0.0000 0.0000 0.0000 LDC-MEAN-ALL-Macro doughnutPRIS_SF_ENG_5 ALL 0.0774 0.0884 0.0754 *ALL-Macro Prec, Recall and F1 refer to mean-precision, mean-recall and mean-F1. NIL-DETECTION P/R/F1: 0.1898 0.5122 0.2770