========================================================== TAC KBP 2016 CROSS-LINGUAL SLOT FILLING EVALUATION RESULTS ========================================================== Team ID: LDC Organization: Linguistic Data Consortium ************************************************************* Run ID: LDC_SF_XLING_1 Did the run access the live Web during the evaluation window: Yes Did the run extract relations from the Cold Start source corpus: Yes Did the run generate meaningful confidence values: Yes Run number of the English SF system that is most closely configured to the English component of this run: 1 Run number of the Spanish SF system that is most closely configured to the Spanish component of this run: 1 Run number of the Chinese SF system that is most closely configured to the Chinese component of this run: 1 Slot Filling Evaluation: Metric RunID Hop Prec Recall F1 SF-ALL-Micro LDC_SF_XLING_1 0 0.7680 0.3017 0.4332 SF-ALL-Micro LDC_SF_XLING_1 1 0.7611 0.1313 0.2240 SF-ALL-Micro LDC_SF_XLING_1 ALL 0.7668 0.2464 0.3730 SF-ALL-Macro LDC_SF_XLING_1 0 0.8597 0.6832 0.7023 SF-ALL-Macro LDC_SF_XLING_1 1 0.1715 0.1591 0.1593 SF-ALL-Macro LDC_SF_XLING_1 ALL 0.5077 0.4152 0.4246 LDC-MAX-ALL-Micro LDC_SF_XLING_1 0 0.7697 0.3151 0.4472 LDC-MAX-ALL-Micro LDC_SF_XLING_1 1 0.8037 0.4230 0.5542 LDC-MAX-ALL-Micro LDC_SF_XLING_1 ALL 0.7831 0.3513 0.4850 LDC-MAX-ALL-Macro LDC_SF_XLING_1 0 0.8749 0.7099 0.7276 LDC-MAX-ALL-Macro LDC_SF_XLING_1 1 0.5804 0.5384 0.5392 LDC-MAX-ALL-Macro LDC_SF_XLING_1 ALL 0.7292 0.6250 0.6344 LDC-MEAN-ALL-Macro LDC_SF_XLING_1 0 0.8749 0.7099 0.7276 LDC-MEAN-ALL-Macro LDC_SF_XLING_1 1 0.2102 0.1890 0.1904 LDC-MEAN-ALL-Macro LDC_SF_XLING_1 ALL 0.5460 0.4521 0.4618 *ALL-Macro Prec, Recall and F1 refer to mean-precision, mean-recall and mean-F1. NIL-DETECTION P/R/F1: 0.2111 0.5854 0.3103