========================================= TAC 2019 SM-KBP TASK 2 EVALUATION RESULTS ========================================= Team ID: OPERA Organization: Carnegie Mellon University; USC Information Sciences Institute (ISI) ********************** Task 2 Zerohop Queries GT Sub Pooled Correct Dup Incrct Cntd Right Wrong Ignrd AP-B AP-W AP-T Run_ID 3178 172 172 169 0 3 172 169 3 0 0.1712 0.1712 0.1712 GAIA_1.OPERA_TA2_V5p 3178 25 25 14 0 11 25 14 11 0 0.0197 0.0197 0.0197 OPERA_TA1a_aditi_V5.OPERA_TA2_aditi_V5 3178 94 94 78 0 16 94 78 16 0 0.1469 0.1374 0.1453 OPERA_TA1a_hans_V3.OPERA_TA2_hans_V5 ******************************************************************* Task 2 Graph Queries -- Strategy 1 (pool and evaluate single edges) GTA(1a) GT(1a) GTA(1b) GT(1b) Sub Pooled Correct PJLnkabl2O OLnkabl2QE Dup Incrct Cntd Right Wrong Ignrd Salient Prec(1a) Recall(1a) F1(1a) Recall(1b) Run_ID 680 472 176 175 1254 268 225 130 130 54 43 154 76 78 114 15 0.4935 0.1610 0.2428 0.0857 GAIA_1.OPERA_TA2_V5p 680 472 176 175 18 18 10 1 1 0 8 12 1 11 6 0 0.0833 0.0021 0.0041 0.0000 OPERA_TA1a_aditi_V5.OPERA_TA2_aditi_V5 680 472 176 175 1226 196 161 73 61 18 35 106 43 63 90 6 0.4057 0.0911 0.1488 0.0343 OPERA_TA1a_hans_V3.OPERA_TA2_hans_V5