======================================================= TAC KBP 2015 COLD START SLOT FILLING EVALUATION RESULTS ======================================================= Team ID: UTAustin Organization: University of Texas at Austin ************************************************************* Run ID: UTAustin1 Did the run access the live Web during the evaluation window: No Run Number of most similar Cold Start KB Construction task submission: NA Did the run extract relations from the Cold Start source corpus: Yes Did the run generate meaningful confidence values: Yes Slot Filling Evaluation: Metric Hop GoldT Submit Correct Incorrect Inexact PIncorrect Dup Right Wrong Prec Recall F1 CSSF micro 0 4840 683 340 296 47 0 3 337 346 0.4934 0.0696 0.1220 CSSF micro 1 3954 0 0 0 0 0 0 0 0 0.0000 0.0000 0.0000 CSSF micro ALL 8794 683 340 296 47 0 3 337 346 0.4934 0.0383 0.0711 LDC-MEAN macro 0 0.1011 LDC-MEAN macro 1 0.0000 LDC-MEAN macro ALL 0.0649 LDC-MAX micro 0 1268 282 184 85 13 0 2 182 100 0.6454 0.1435 0.2348 LDC-MAX micro 1 900 0 0 0 0 0 0 0 0 0.0000 0.0000 0.0000 LDC-MAX micro ALL 2168 282 184 85 13 0 2 182 100 0.6454 0.0839 0.1486 LDC-MAX macro 0 0.2168 LDC-MAX macro 1 0.0000 LDC-MAX macro ALL 0.1392