========================================= TAC 2019 SM-KBP TASK 2 EVALUATION RESULTS ========================================= Team ID: GAIA Organization: USC-ISI; UIUC; Columbia University; University of Florida ********************** Task 2 Zerohop Queries GT Sub Pooled Correct Dup Incrct Cntd Right Wrong Ignrd AP-B AP-W AP-T Run_ID 3178 1287 798 694 0 104 798 694 104 0 0.2879 0.2867 0.2874 GAIA_1.GAIA_2 3178 2166 1007 924 0 83 1007 924 83 0 0.3247 0.3201 0.3230 GAIA_1.GAIA_2p 3178 1164 675 620 0 55 675 620 55 0 0.2936 0.2924 0.2934 GAIA_2.GAIA_2 3178 652 652 318 0 334 652 318 334 0 0.2200 0.1857 0.1998 OPERA_TA1a_hans_V2.GAIA_1 ******************************************************************* Task 2 Graph Queries -- Strategy 1 (pool and evaluate single edges) GTA(1a) GT(1a) GTA(1b) GT(1b) Sub Pooled Correct PJLnkabl2O OLnkabl2QE Dup Incrct Cntd Right Wrong Ignrd Salient Prec(1a) Recall(1a) F1(1a) Recall(1b) Run_ID 680 472 176 175 967 265 216 129 129 61 49 147 68 79 118 11 0.4626 0.1441 0.2197 0.0629 GAIA_1.GAIA_2 680 472 176 175 976 259 203 143 142 72 56 144 70 74 115 14 0.4861 0.1483 0.2273 0.0800 GAIA_1.GAIA_2p 680 472 176 175 1386 281 219 129 126 57 62 168 69 99 113 15 0.4107 0.1462 0.2156 0.0857 GAIA_2.GAIA_2 680 472 176 175 2004 248 207 99 93 53 41 114 40 74 134 6 0.3509 0.0847 0.1365 0.0343 OPERA_TA1a_hans_V2.GAIA_1