========================================= TAC 2019 SM-KBP TASK 2 EVALUATION RESULTS ========================================= Team ID: SAMSON Organization: Raytheon BBN Technologies ********************** Task 2 Zerohop Queries GT Sub Pooled Correct Dup Incrct Cntd Right Wrong Ignrd AP-B AP-W AP-T Run_ID 3178 2403 1353 966 0 387 1353 966 387 0 0.3199 0.1934 0.2456 BBN_1.BBN_TA2_v2 3178 0 0 0 0 0 0 0 0 0 0.0000 0.0000 0.0000 GAIA_2_final.BBN_TA2_v2 3178 0 0 0 0 0 0 0 0 0 0.0000 0.0000 0.0000 GAIA_2_final.BBN_TA2_v3 3178 0 0 0 0 0 0 0 0 0 0.0000 0.0000 0.0000 GAIA_2_final.BBN_TA2_v3_ZH_split_all 3178 0 0 0 0 0 0 0 0 0 0.0000 0.0000 0.0000 Michigan_1.BBN_TA2_v2 3178 0 0 0 0 0 0 0 0 0 0.0000 0.0000 0.0000 Michigan_1.BBN_TA2_v3 3178 739 697 614 0 83 697 614 83 0 0.2989 0.2190 0.2692 OPERA_TA1a_hans_V2.BBN_TA2_v1 ******************************************************************* Task 2 Graph Queries -- Strategy 1 (pool and evaluate single edges) GTA(1a) GT(1a) GTA(1b) GT(1b) Sub Pooled Correct PJLnkabl2O OLnkabl2QE Dup Incrct Cntd Right Wrong Ignrd Salient Prec(1a) Recall(1a) F1(1a) Recall(1b) Run_ID 680 472 176 175 274 162 128 100 81 40 34 110 41 69 52 8 0.3727 0.0869 0.1409 0.0457 BBN_1.BBN_TA2_v2 680 472 176 175 743 321 239 176 150 84 82 197 66 131 124 16 0.3350 0.1398 0.1973 0.0914 GAIA_2_final.BBN_TA2_v2 680 472 176 175 0 0 0 0 0 0 0 0 0 0 0 0 0.0000 0.0000 0.0000 0.0000 GAIA_2_final.BBN_TA2_v3 680 472 176 175 175 88 24 0 0 0 64 76 0 76 12 0 0.0000 0.0000 0.0000 0.0000 Michigan_1.BBN_TA2_v2 680 472 176 175 175 88 25 0 0 0 63 75 0 75 13 0 0.0000 0.0000 0.0000 0.0000 Michigan_1.BBN_TA2_v3 680 472 176 175 170 132 104 31 29 10 28 60 19 41 72 4 0.3167 0.0403 0.0714 0.0229 OPERA_TA1a_hans_V2.BBN_TA2_v1