================================================================ TAC 2020 EPIDEMIC QUESTION ANSWERING EVALUATION RESULTS (TASK A) ================================================================ Team ID: Yastil_R Organization(s): University of KwaZulu-Natal, Centre for AI Research South Africa Run: Yastil_R_1 Query Metric Score Median Maximum EQ101 NDNS-Exact 0.5524 0.4974 0.6811 EQ101 NDNS-Partial 0.4573 0.4186 0.5638 EQ101 NDNS-Relaxed 0.4573 0.4186 0.5638 EQ102 NDNS-Exact 0.2996 0.3410 0.5418 EQ102 NDNS-Partial 0.2737 0.3115 0.4950 EQ102 NDNS-Relaxed 0.2737 0.3115 0.4950 EQ103 NDNS-Exact 0.2739 0.2500 0.3667 EQ103 NDNS-Partial 0.2276 0.2078 0.3048 EQ103 NDNS-Relaxed 0.2276 0.2078 0.3048 EQ104 NDNS-Exact 0.1111 0.4219 0.6273 EQ104 NDNS-Partial 0.1036 0.4080 0.6397 EQ104 NDNS-Relaxed 0.1036 0.4080 0.5977 EQ105 NDNS-Exact 0.7001 0.2766 0.7001 EQ105 NDNS-Partial 0.6617 0.2784 0.6617 EQ105 NDNS-Relaxed 0.6617 0.2784 0.6617 EQ106 NDNS-Exact 0.4226 0.4169 0.6451 EQ106 NDNS-Partial 0.3423 0.3377 0.5332 EQ106 NDNS-Relaxed 0.3423 0.3377 0.5225 EQ107 NDNS-Exact 0.1284 0.1240 0.1839 EQ107 NDNS-Partial 0.1184 0.1144 0.1695 EQ107 NDNS-Relaxed 0.1184 0.1144 0.1695 EQ108 NDNS-Exact 0.5045 0.3949 0.6287 EQ108 NDNS-Partial 0.4319 0.3380 0.5382 EQ108 NDNS-Relaxed 0.4319 0.3380 0.5382 EQ109 NDNS-Exact 1.0000 0.6309 1.0000 EQ109 NDNS-Partial 1.0000 0.7500 1.0000 EQ109 NDNS-Relaxed 1.0000 0.7500 1.0000 EQ110 NDNS-Exact 0.2980 0.3887 0.5470 EQ110 NDNS-Partial 0.2317 0.3022 0.4270 EQ110 NDNS-Relaxed 0.2294 0.2992 0.4210 EQ111 NDNS-Exact 0.4571 0.4480 0.5874 EQ111 NDNS-Partial 0.3586 0.3620 0.5094 EQ111 NDNS-Relaxed 0.3686 0.3688 0.5236 EQ112 NDNS-Exact 0.2917 0.5012 0.5953 EQ112 NDNS-Partial 0.2525 0.4338 0.5153 EQ112 NDNS-Relaxed 0.2525 0.4338 0.5153 EQ113 NDNS-Exact 0.4084 0.3610 0.5062 EQ113 NDNS-Partial 0.3972 0.3511 0.4923 EQ113 NDNS-Relaxed 0.3972 0.3511 0.4923 EQ114 NDNS-Exact 0.6719 0.3145 0.6719 EQ114 NDNS-Partial 0.6492 0.3039 0.6492 EQ114 NDNS-Relaxed 0.6492 0.3039 0.6492 EQ115 NDNS-Exact 0.2436 0.1533 0.2688 EQ115 NDNS-Partial 0.2322 0.1461 0.2561 EQ115 NDNS-Relaxed 0.2329 0.1466 0.2570 EQ116 NDNS-Exact 0.2718 0.2327 0.3331 EQ116 NDNS-Partial 0.2404 0.2058 0.2946 EQ116 NDNS-Relaxed 0.2404 0.2058 0.2946 EQ117 NDNS-Exact 0.4989 0.3511 0.5322 EQ117 NDNS-Partial 0.4980 0.3715 0.6085 EQ117 NDNS-Relaxed 0.4980 0.3715 0.6085 EQ118 NDNS-Exact 0.5989 0.5646 0.6908 EQ118 NDNS-Partial 0.4625 0.4360 0.5335 EQ118 NDNS-Relaxed 0.4625 0.4360 0.5335 EQ119 NDNS-Exact 0.3002 0.2868 0.4027 EQ119 NDNS-Partial 0.2286 0.2263 0.3067 EQ119 NDNS-Relaxed 0.2286 0.2244 0.3067 EQ120 NDNS-Exact 0.5448 0.5027 0.7176 EQ120 NDNS-Partial 0.5137 0.4740 0.6767 EQ120 NDNS-Relaxed 0.5199 0.4798 0.6849 EQ121 NDNS-Exact 0.4065 0.3903 0.4689 EQ121 NDNS-Partial 0.3978 0.3819 0.4589 EQ121 NDNS-Relaxed 0.3978 0.3819 0.4589 EQ122 NDNS-Exact 0.3407 0.2465 0.3862 EQ122 NDNS-Partial 0.2843 0.2078 0.3409 EQ122 NDNS-Relaxed 0.2862 0.2092 0.3244 EQ123 NDNS-Exact 0.5450 0.5079 0.6317 EQ123 NDNS-Partial 0.4221 0.3934 0.4892 EQ123 NDNS-Relaxed 0.4231 0.3943 0.4904 EQ124 NDNS-Exact 0.5438 0.4694 0.6163 EQ124 NDNS-Partial 0.4674 0.4035 0.5298 EQ124 NDNS-Relaxed 0.4674 0.4035 0.5298 EQ125 NDNS-Exact 0.1369 0.3250 0.8570 EQ125 NDNS-Partial 0.1150 0.2731 0.7201 EQ125 NDNS-Relaxed 0.1150 0.2731 0.7201 EQ126 NDNS-Exact 0.6099 0.2966 0.6099 EQ126 NDNS-Partial 0.4927 0.2396 0.4927 EQ126 NDNS-Relaxed 0.4952 0.2408 0.4952 EQ127 NDNS-Exact 0.5331 0.4034 0.5870 EQ127 NDNS-Partial 0.4596 0.3684 0.5060 EQ127 NDNS-Relaxed 0.4687 0.3737 0.5160 EQ128 NDNS-Exact 0.3251 0.3416 0.4318 EQ128 NDNS-Partial 0.2411 0.2551 0.3393 EQ128 NDNS-Relaxed 0.2432 0.2555 0.3331 EQ129 NDNS-Exact 0.0268 0.1448 0.3360 EQ129 NDNS-Partial 0.0223 0.1205 0.2868 EQ129 NDNS-Relaxed 0.0223 0.1205 0.2868 EQ130 NDNS-Exact 0.2561 0.4404 0.6946 EQ130 NDNS-Partial 0.2561 0.4535 0.6946 EQ130 NDNS-Relaxed 0.2561 0.4535 0.6946 MEAN NDNS-Exact 0.4101 0.3802 0.4207 MEAN NDNS-Partial 0.3613 0.3377 0.3699 MEAN NDNS-Relaxed 0.3624 0.3387 0.3709 ******************************************************* Run: Yastil_R_2 Query Metric Score Median Maximum EQ101 NDNS-Exact 0.6139 0.4974 0.6811 EQ101 NDNS-Partial 0.5082 0.4186 0.5638 EQ101 NDNS-Relaxed 0.5082 0.4186 0.5638 EQ102 NDNS-Exact 0.2413 0.3410 0.5418 EQ102 NDNS-Partial 0.2205 0.3115 0.4950 EQ102 NDNS-Relaxed 0.2205 0.3115 0.4950 EQ103 NDNS-Exact 0.3152 0.2500 0.3667 EQ103 NDNS-Partial 0.2620 0.2078 0.3048 EQ103 NDNS-Relaxed 0.2620 0.2078 0.3048 EQ104 NDNS-Exact 0.3222 0.4219 0.6273 EQ104 NDNS-Partial 0.3004 0.4080 0.6397 EQ104 NDNS-Relaxed 0.3004 0.4080 0.5977 EQ105 NDNS-Exact 0.2352 0.2766 0.7001 EQ105 NDNS-Partial 0.2223 0.2784 0.6617 EQ105 NDNS-Relaxed 0.2223 0.2784 0.6617 EQ106 NDNS-Exact 0.4603 0.4169 0.6451 EQ106 NDNS-Partial 0.3728 0.3377 0.5332 EQ106 NDNS-Relaxed 0.3728 0.3377 0.5225 EQ107 NDNS-Exact 0.1839 0.1240 0.1839 EQ107 NDNS-Partial 0.1695 0.1144 0.1695 EQ107 NDNS-Relaxed 0.1695 0.1144 0.1695 EQ108 NDNS-Exact 0.3226 0.3949 0.6287 EQ108 NDNS-Partial 0.2762 0.3380 0.5382 EQ108 NDNS-Relaxed 0.2762 0.3380 0.5382 EQ109 NDNS-Exact 1.0000 0.6309 1.0000 EQ109 NDNS-Partial 1.0000 0.7500 1.0000 EQ109 NDNS-Relaxed 1.0000 0.7500 1.0000 EQ110 NDNS-Exact 0.3284 0.3887 0.5470 EQ110 NDNS-Partial 0.2554 0.3022 0.4270 EQ110 NDNS-Relaxed 0.2528 0.2992 0.4210 EQ111 NDNS-Exact 0.5161 0.4480 0.5874 EQ111 NDNS-Partial 0.4049 0.3620 0.5094 EQ111 NDNS-Relaxed 0.4162 0.3688 0.5236 EQ112 NDNS-Exact 0.5953 0.5012 0.5953 EQ112 NDNS-Partial 0.5153 0.4338 0.5153 EQ112 NDNS-Relaxed 0.5153 0.4338 0.5153 EQ113 NDNS-Exact 0.3826 0.3610 0.5062 EQ113 NDNS-Partial 0.3721 0.3511 0.4923 EQ113 NDNS-Relaxed 0.3721 0.3511 0.4923 EQ114 NDNS-Exact 0.3707 0.3145 0.6719 EQ114 NDNS-Partial 0.3582 0.3039 0.6492 EQ114 NDNS-Relaxed 0.3582 0.3039 0.6492 EQ115 NDNS-Exact 0.1202 0.1533 0.2688 EQ115 NDNS-Partial 0.1146 0.1461 0.2561 EQ115 NDNS-Relaxed 0.1149 0.1466 0.2570 EQ116 NDNS-Exact 0.2365 0.2327 0.3331 EQ116 NDNS-Partial 0.2092 0.2058 0.2946 EQ116 NDNS-Relaxed 0.2092 0.2058 0.2946 EQ117 NDNS-Exact 0.4086 0.3511 0.5322 EQ117 NDNS-Partial 0.4079 0.3715 0.6085 EQ117 NDNS-Relaxed 0.4079 0.3715 0.6085 EQ118 NDNS-Exact 0.6908 0.5646 0.6908 EQ118 NDNS-Partial 0.5335 0.4360 0.5335 EQ118 NDNS-Relaxed 0.5335 0.4360 0.5335 EQ119 NDNS-Exact 0.2744 0.2868 0.4027 EQ119 NDNS-Partial 0.2089 0.2263 0.3067 EQ119 NDNS-Relaxed 0.2089 0.2244 0.3067 EQ120 NDNS-Exact 0.4537 0.5027 0.7176 EQ120 NDNS-Partial 0.4278 0.4740 0.6767 EQ120 NDNS-Relaxed 0.4330 0.4798 0.6849 EQ121 NDNS-Exact 0.2925 0.3903 0.4689 EQ121 NDNS-Partial 0.2863 0.3819 0.4589 EQ121 NDNS-Relaxed 0.2863 0.3819 0.4589 EQ122 NDNS-Exact 0.2511 0.2465 0.3862 EQ122 NDNS-Partial 0.2095 0.2078 0.3409 EQ122 NDNS-Relaxed 0.2109 0.2092 0.3244 EQ123 NDNS-Exact 0.5381 0.5079 0.6317 EQ123 NDNS-Partial 0.4167 0.3934 0.4892 EQ123 NDNS-Relaxed 0.4177 0.3943 0.4904 EQ124 NDNS-Exact 0.4715 0.4694 0.6163 EQ124 NDNS-Partial 0.4053 0.4035 0.5298 EQ124 NDNS-Relaxed 0.4053 0.4035 0.5298 EQ125 NDNS-Exact 0.1016 0.3250 0.8570 EQ125 NDNS-Partial 0.0854 0.2731 0.7201 EQ125 NDNS-Relaxed 0.0854 0.2731 0.7201 EQ126 NDNS-Exact 0.3951 0.2966 0.6099 EQ126 NDNS-Partial 0.3191 0.2396 0.4927 EQ126 NDNS-Relaxed 0.3208 0.2408 0.4952 EQ127 NDNS-Exact 0.5870 0.4034 0.5870 EQ127 NDNS-Partial 0.5060 0.3684 0.5060 EQ127 NDNS-Relaxed 0.5160 0.3737 0.5160 EQ128 NDNS-Exact 0.3324 0.3416 0.4318 EQ128 NDNS-Partial 0.2465 0.2551 0.3393 EQ128 NDNS-Relaxed 0.2486 0.2555 0.3331 EQ129 NDNS-Exact 0.0000 0.1448 0.3360 EQ129 NDNS-Partial 0.0000 0.1205 0.2868 EQ129 NDNS-Relaxed 0.0000 0.1205 0.2868 EQ130 NDNS-Exact 0.5066 0.4404 0.6946 EQ130 NDNS-Partial 0.5066 0.4535 0.6946 EQ130 NDNS-Relaxed 0.5066 0.4535 0.6946 MEAN NDNS-Exact 0.3849 0.3802 0.4207 MEAN NDNS-Partial 0.3374 0.3377 0.3699 MEAN NDNS-Relaxed 0.3384 0.3387 0.3709 *******************************************************