==================================================== TAC KBP 2016 CHINESE SLOT FILLING EVALUATION RESULTS ==================================================== Team ID: RPI_BLENDER Organization: Rensselaer Polytechnic Institute ************************************************************* Run ID: RPI_BLENDER_SF_CMN_1 Did the run access the live Web during the evaluation window: No Did the run extract relations from the Cold Start source corpus: Yes Did the run generate meaningful confidence values: Yes Slot Filling Evaluation: Metric RunID Hop Prec Recall F1 SF-ALL-Micro RPI_BLENDER_SF_CMN_1 0 0.3832 0.0546 0.0956 SF-ALL-Micro RPI_BLENDER_SF_CMN_1 1 0.3333 0.0130 0.0251 SF-ALL-Micro RPI_BLENDER_SF_CMN_1 ALL 0.3793 0.0449 0.0802 SF-ALL-Macro RPI_BLENDER_SF_CMN_1 0 0.1341 0.1036 0.1040 SF-ALL-Macro RPI_BLENDER_SF_CMN_1 1 0.0199 0.0199 0.0199 SF-ALL-Macro RPI_BLENDER_SF_CMN_1 ALL 0.0812 0.0648 0.0650 LDC-MAX-ALL-Micro RPI_BLENDER_SF_CMN_1 0 0.4270 0.0710 0.1218 LDC-MAX-ALL-Micro RPI_BLENDER_SF_CMN_1 1 0.3333 0.0163 0.0311 LDC-MAX-ALL-Micro RPI_BLENDER_SF_CMN_1 ALL 0.4184 0.0570 0.1004 LDC-MAX-ALL-Macro RPI_BLENDER_SF_CMN_1 0 0.1564 0.1194 0.1193 LDC-MAX-ALL-Macro RPI_BLENDER_SF_CMN_1 1 0.0273 0.0273 0.0273 LDC-MAX-ALL-Macro RPI_BLENDER_SF_CMN_1 ALL 0.0982 0.0779 0.0778 LDC-MEAN-ALL-Macro RPI_BLENDER_SF_CMN_1 0 0.1491 0.1115 0.1130 LDC-MEAN-ALL-Macro RPI_BLENDER_SF_CMN_1 1 0.0227 0.0227 0.0227 LDC-MEAN-ALL-Macro RPI_BLENDER_SF_CMN_1 ALL 0.0921 0.0715 0.0723 *ALL-Macro Prec, Recall and F1 refer to mean-precision, mean-recall and mean-F1. NIL-DETECTION P/R/F1: 0.2977 0.9268 0.4506 ************************************************************* Run ID: RPI_BLENDER_SF_CMN_2 Did the run access the live Web during the evaluation window: No Did the run extract relations from the Cold Start source corpus: Yes Did the run generate meaningful confidence values: Yes Slot Filling Evaluation: Metric RunID Hop Prec Recall F1 SF-ALL-Micro RPI_BLENDER_SF_CMN_2 0 0.3846 0.0533 0.0936 SF-ALL-Micro RPI_BLENDER_SF_CMN_2 1 0.4286 0.0130 0.0253 SF-ALL-Micro RPI_BLENDER_SF_CMN_2 ALL 0.3874 0.0438 0.0788 SF-ALL-Macro RPI_BLENDER_SF_CMN_2 0 0.1324 0.1017 0.1020 SF-ALL-Macro RPI_BLENDER_SF_CMN_2 1 0.0199 0.0199 0.0199 SF-ALL-Macro RPI_BLENDER_SF_CMN_2 ALL 0.0803 0.0638 0.0640 LDC-MAX-ALL-Micro RPI_BLENDER_SF_CMN_2 0 0.4405 0.0692 0.1195 LDC-MAX-ALL-Micro RPI_BLENDER_SF_CMN_2 1 0.4286 0.0163 0.0314 LDC-MAX-ALL-Micro RPI_BLENDER_SF_CMN_2 ALL 0.4396 0.0556 0.0988 LDC-MAX-ALL-Macro RPI_BLENDER_SF_CMN_2 0 0.1542 0.1169 0.1168 LDC-MAX-ALL-Macro RPI_BLENDER_SF_CMN_2 1 0.0273 0.0273 0.0273 LDC-MAX-ALL-Macro RPI_BLENDER_SF_CMN_2 ALL 0.0970 0.0765 0.0764 LDC-MEAN-ALL-Macro RPI_BLENDER_SF_CMN_2 0 0.1480 0.1103 0.1117 LDC-MEAN-ALL-Macro RPI_BLENDER_SF_CMN_2 1 0.0227 0.0227 0.0227 LDC-MEAN-ALL-Macro RPI_BLENDER_SF_CMN_2 ALL 0.0915 0.0708 0.0716 *ALL-Macro Prec, Recall and F1 refer to mean-precision, mean-recall and mean-F1. NIL-DETECTION P/R/F1: 0.2995 0.9350 0.4537