======================================================= TAC KBP 2015 COLD START SLOT FILLING EVALUATION RESULTS ======================================================= Team ID: LDC Organization: Linguistic Data Consortium ************************************************************* Run ID: LDC Did the run access the live Web during the evaluation window: No Run Number of most similar Cold Start KB Construction task submission: NA Did the run extract relations from the Cold Start source corpus: Yes Did the run generate meaningful confidence values: No Slot Filling Evaluation: Metric Hop GoldT Submit Correct Incorrect Inexact PIncorrect Dup Right Wrong Prec Recall F1 CSSF micro 0 4840 1253 1074 124 55 0 0 1074 179 0.8571 0.2219 0.3525 CSSF micro 1 3954 618 487 54 17 60 0 487 131 0.7880 0.1232 0.2130 CSSF micro ALL 8794 1871 1561 178 72 60 0 1561 310 0.8343 0.1775 0.2927 LDC-MEAN macro 0 0.4945 LDC-MEAN macro 1 0.3812 LDC-MEAN macro ALL 0.4539 LDC-MAX micro 0 1268 347 290 41 16 0 0 290 57 0.8357 0.2287 0.3591 LDC-MAX micro 1 900 160 123 12 6 19 0 123 37 0.7688 0.1367 0.2321 LDC-MAX micro ALL 2168 507 413 53 22 19 0 413 94 0.8146 0.1905 0.3088 LDC-MAX macro 0 0.4945 LDC-MAX macro 1 0.3812 LDC-MAX macro ALL 0.4539