==================================================== TAC KBP 2016 SPANISH SLOT FILLING EVALUATION RESULTS ==================================================== Team ID: LDC Organization: Linguistic Data Consortium ************************************************************* Run ID: LDC_SF_SPA_1 Did the run access the live Web during the evaluation window: Yes Did the run extract relations from the Cold Start source corpus: Yes Did the run generate meaningful confidence values: Yes Slot Filling Evaluation: Metric RunID Hop Prec Recall F1 SF-ALL-Micro LDC_SF_SPA_1 0 0.8657 0.5633 0.6825 SF-ALL-Micro LDC_SF_SPA_1 1 0.8244 0.5070 0.6279 SF-ALL-Micro LDC_SF_SPA_1 ALL 0.8501 0.5413 0.6614 SF-ALL-Macro LDC_SF_SPA_1 0 0.7921 0.7158 0.7308 SF-ALL-Macro LDC_SF_SPA_1 1 0.6015 0.6014 0.5983 SF-ALL-Macro LDC_SF_SPA_1 ALL 0.7285 0.6777 0.6866 LDC-MAX-ALL-Micro LDC_SF_SPA_1 0 0.8800 0.5301 0.6617 LDC-MAX-ALL-Micro LDC_SF_SPA_1 1 0.8571 0.8571 0.8571 LDC-MAX-ALL-Micro LDC_SF_SPA_1 ALL 0.8696 0.6400 0.7373 LDC-MAX-ALL-Macro LDC_SF_SPA_1 0 0.7854 0.7002 0.7171 LDC-MAX-ALL-Macro LDC_SF_SPA_1 1 0.8580 0.8578 0.8535 LDC-MAX-ALL-Macro LDC_SF_SPA_1 ALL 0.8092 0.7520 0.7619 LDC-MEAN-ALL-Macro LDC_SF_SPA_1 0 0.7854 0.7002 0.7171 LDC-MEAN-ALL-Macro LDC_SF_SPA_1 1 0.7010 0.7010 0.6988 LDC-MEAN-ALL-Macro LDC_SF_SPA_1 ALL 0.7577 0.7005 0.7111 *ALL-Macro Prec, Recall and F1 refer to mean-precision, mean-recall and mean-F1. NIL-DETECTION P/R/F1: 0.2769 0.8374 0.4162