========================================= TAC 2019 SM-KBP TASK 1 EVALUATION RESULTS ========================================= Team ID: GAIA Organization: USC-ISI; UIUC; Columbia University; University of Florida TA1b_GAIA_1_final (for Task 1b) is comparable to TA1a_GAIA_1_final (for Task 1a), and operates in the context of one of the what-if hypotheses (for E101, E102, or E103) TA1b_GAIA_2_final (for Task 1b) is comparable to TA1a_GAIA_2_final (for Task 1a), and operates in the context of one of the what-if hypotheses (for E101, E102, or E103) ******************** Task 1 Class Queries GT Sub Pooled Correct Dup Incrct Cntd Right Wrong Ignrd AP-B AP-W AP-T Run_ID 1126 1817 1817 1666 1179 151 1817 487 1330 0 0.4265 0.4086 0.4132 TA1a_GAIA_1_IJC 1126 1817 1817 1666 1179 151 1817 487 1330 0 0.4265 0.4086 0.4132 TA1a_GAIA_1_WEEV 1126 1901 1901 1719 1199 182 1901 520 1381 0 0.4830 0.4724 0.4759 TA1a_GAIA_1_final 1126 1806 1806 1644 1160 162 1806 484 1322 0 0.4109 0.4034 0.4065 TA1a_GAIA_1_original 1126 1820 1820 1668 1179 152 1820 489 1331 0 0.4272 0.4093 0.4140 TA1a_GAIA_2_IJC 1126 1817 1817 1667 1179 150 1817 488 1329 0 0.4293 0.4114 0.4161 TA1a_GAIA_2_WEEV 1126 1901 1901 1720 1201 181 1901 519 1382 0 0.4843 0.4737 0.4773 TA1a_GAIA_2_final 1126 1798 1798 1633 1155 165 1798 478 1320 0 0.4033 0.3958 0.3988 TA1a_GAIA_2_original 1126 1903 1903 1724 1201 179 1903 523 1380 0 0.4943 0.4837 0.4873 TA1b_GAIA_1_final-E101_PT003 1126 1905 1905 1722 1202 183 1905 520 1385 0 0.4847 0.4741 0.4759 TA1b_GAIA_1_final-E102_PT002 1126 1902 1902 1720 1198 182 1902 522 1380 0 0.4881 0.4775 0.4811 TA1b_GAIA_1_final-E103_PT001 1126 1908 1908 1726 1200 182 1908 526 1382 0 0.4938 0.4833 0.4850 TA1b_GAIA_2_final-E101_PT003 1126 1899 1899 1715 1197 184 1899 518 1381 0 0.4854 0.4749 0.4767 TA1b_GAIA_2_final-E102_PT002 1126 1903 1903 1721 1201 182 1903 520 1383 0 0.4863 0.4757 0.4793 TA1b_GAIA_2_final-E103_PT001 ******************** Task 1 Graph Queries GTA GT Sub Pooled Correct PJLnkabl2O Dup Incrct Cntd Right Wrong Ignrd Prec Recall F1 Run_ID 994 994 271 271 209 146 14 62 232 132 100 39 0.5690 0.1328 0.2153 TA1a_GAIA_1_IJC 994 994 271 271 209 146 13 62 233 133 100 38 0.5708 0.1338 0.2168 TA1a_GAIA_1_WEEV 994 994 336 336 240 164 18 96 284 146 138 52 0.5141 0.1469 0.2285 TA1a_GAIA_1_final 994 994 273 273 209 136 13 64 238 123 115 35 0.5168 0.1237 0.1997 TA1a_GAIA_1_original 994 994 415 415 325 218 24 90 364 194 170 51 0.5330 0.1952 0.2857 TA1a_GAIA_2_IJC 994 994 410 410 320 217 25 90 361 192 169 49 0.5319 0.1932 0.2834 TA1a_GAIA_2_WEEV 994 994 541 541 386 266 51 155 456 215 241 85 0.4715 0.2163 0.2966 TA1a_GAIA_2_final 994 994 412 412 319 198 18 93 370 180 190 42 0.4865 0.1811 0.2639 TA1a_GAIA_2_original 994 994 336 336 240 163 18 96 283 145 138 53 0.5124 0.1459 0.2271 TA1b_GAIA_1_final-E101_PT003 994 994 341 341 245 169 21 96 286 148 138 55 0.5175 0.1489 0.2313 TA1b_GAIA_1_final-E102_PT002 994 994 336 336 240 163 18 96 283 145 138 53 0.5124 0.1459 0.2271 TA1b_GAIA_1_final-E103_PT001 994 994 529 529 376 264 49 153 448 215 233 81 0.4799 0.2163 0.2982 TA1b_GAIA_2_final-E101_PT003 994 994 533 533 380 265 50 153 449 215 234 84 0.4788 0.2163 0.2980 TA1b_GAIA_2_final-E102_PT002 994 994 541 541 386 266 51 155 456 215 241 85 0.4715 0.2163 0.2966 TA1b_GAIA_2_final-E103_PT001