========================================= TAC 2019 SM-KBP TASK 1 EVALUATION RESULTS ========================================= Team ID: michigan Organization: University of Michigan; Princeton University TA1b_Michigan_1 (for Task 1b) is comparable to TA1a_Michigan_2 (for Task 1a), and operates in the context of one of the what-if hypotheses (for E101, E102, or E103) ******************** Task 1 Class Queries GT Sub Pooled Correct Dup Incrct Cntd Right Wrong Ignrd AP-B AP-W AP-T Run_ID 1126 1489 1489 615 328 874 1489 287 1202 0 0.2290 0.0892 0.1244 TA1a_Michigan_1 1126 1040 1040 485 221 555 1040 264 776 0 0.2067 0.0939 0.1106 TA1a_Michigan_2 1126 1040 1040 485 221 555 1040 264 776 0 0.1621 0.1386 0.1411 TA1b_Michigan_1-E101_PT103 1126 1040 1040 485 221 555 1040 264 776 0 0.1637 0.1412 0.1447 TA1b_Michigan_1-E102_PT102 1126 1040 1040 485 221 555 1040 264 776 0 0.1594 0.1371 0.1392 TA1b_Michigan_1-E103_PT101 ******************** Task 1 Graph Queries GTA GT Sub Pooled Correct PJLnkabl2O Dup Incrct Cntd Right Wrong Ignrd Prec Recall F1 Run_ID 994 994 343 309 86 4 0 223 289 4 285 20 0.0138 0.0040 0.0062 TA1a_Michigan_1 994 994 485 398 109 5 1 289 365 4 361 33 0.0110 0.0040 0.0059 TA1a_Michigan_2 994 994 374 303 75 2 0 228 277 2 275 26 0.0072 0.0020 0.0031 TA1b_Michigan_1-E101_PT103 994 994 374 303 75 2 0 228 277 2 275 26 0.0072 0.0020 0.0031 TA1b_Michigan_1-E102_PT102 994 994 374 303 75 2 0 228 277 2 275 26 0.0072 0.0020 0.0031 TA1b_Michigan_1-E103_PT101