=========================================================================== TAC 2018 SYSTEMATIC REVIEW INFORMATION EXTRACTION TASK 1 EVALUATION RESULTS =========================================================================== Team ID: ICF Organization(s): ICF ************************************************************* Task 1 Results RunID Category TP FP FN Precision Recall F1 ICF_1 ALL 6755 26591 8364 20.25730223 44.67888088 27.87578665 ICF_2 ALL 7327 46410 7792 13.63492566 48.46219988 21.28209597 ICF_3 ALL 7527 62925 7592 10.68386987 49.78503869 17.59240864 ICF_1 CellLine 1 3 90 25 1.098901099 2.105263158 ICF_2 CellLine 1 3 90 25 1.098901099 2.105263158 ICF_3 CellLine 1 3 90 25 1.098901099 2.105263158 ICF_2 Dose 285 3453 326 7.624398074 46.64484452 13.10646126 ICF_3 Dose 286 3395 325 7.769627819 46.80851064 13.32712022 ICF_1 Dose 286 3501 325 7.552152099 46.80851064 13.00591178 ICF_2 DoseDuration 12 433 176 2.696629213 6.382978723 3.791469194 ICF_1 DoseDuration 12 436 176 2.678571429 6.382978723 3.773584906 ICF_3 DoseDuration 12 442 176 2.643171806 6.382978723 3.738317757 ICF_1 DoseDurationUnits 93 877 83 9.587628866 52.84090909 16.23036649 ICF_2 DoseDurationUnits 93 879 83 9.567901235 52.84090909 16.20209059 ICF_3 DoseDurationUnits 93 883 83 9.528688525 52.84090909 16.14583333 ICF_1 DoseFrequency 24 202 82 10.61946903 22.64150943 14.45783133 ICF_2 DoseFrequency 24 316 82 7.058823529 22.64150943 10.76233184 ICF_3 DoseFrequency 24 317 82 7.038123167 22.64150943 10.73825503 ICF_1 DoseRoute 408 3743 116 9.828956878 77.86259542 17.45454545 ICF_3 DoseRoute 410 3768 114 9.813307803 78.24427481 17.43938749 ICF_2 DoseRoute 410 3772 114 9.803921569 78.24427481 17.42456439 ICF_1 DoseUnits 257 1455 184 15.01168224 58.27664399 23.87366465 ICF_2 DoseUnits 259 1465 182 15.02320186 58.73015873 23.926097 ICF_3 DoseUnits 259 1470 182 14.97975709 58.73015873 23.87096774 ICF_1 Endpoint 1181 3798 2575 23.71962241 31.44302449 27.0406411 ICF_2 Endpoint 1732 23407 2024 6.889693305 46.11288605 11.98823326 ICF_3 Endpoint 1738 23467 2018 6.895457251 46.27263046 12.00234799 ICF_2 EndpointUnitOfMeasure 409 2097 289 16.32083001 58.59598854 25.53058677 ICF_1 EndpointUnitOfMeasure 411 2084 287 16.47294589 58.88252149 25.74381459 ICF_3 EndpointUnitOfMeasure 415 2105 283 16.46825397 59.45558739 25.79241765 ICF_1 GroupName 444 1363 614 24.57111234 41.96597353 30.9947644 ICF_3 GroupName 444 1365 614 24.54394693 41.96597353 30.97314266 ICF_2 GroupName 446 1366 612 24.61368653 42.15500945 31.08013937 ICF_2 GroupSize 230 1366 266 14.41102757 46.37096774 21.98852772 ICF_1 GroupSize 231 1355 265 14.56494325 46.57258065 22.19020173 ICF_3 GroupSize 233 1372 263 14.51713396 46.97580645 22.17991433 ICF_1 SampleSize 8 356 66 2.197802198 10.81081081 3.652968037 ICF_2 SampleSize 8 362 66 2.162162162 10.81081081 3.603603604 ICF_3 SampleSize 8 365 66 2.144772118 10.81081081 3.579418345 ICF_1 Sex 475 151 133 75.87859425 78.125 76.98541329 ICF_2 Sex 479 153 129 75.79113924 78.78289474 77.25806452 ICF_3 Sex 480 154 128 75.70977918 78.94736842 77.29468599 ICF_1 Species 1362 252 277 84.3866171 83.09945088 83.73808792 ICF_2 Species 1366 253 273 84.3730698 83.34350214 83.85512584 ICF_3 Species 1372 252 267 84.48275862 83.70957901 84.09439166 ICF_1 Strain 159 437 179 26.67785235 47.04142012 34.04710921 ICF_2 Strain 159 439 179 26.58862876 47.04142012 33.97435897 ICF_3 Strain 170 3414 168 4.743303571 50.29585799 8.669046405 ICF_1 TestArticle 634 1307 1573 32.66357548 28.72677843 30.56894889 ICF_2 TestArticle 635 1324 1572 32.41449719 28.77208881 30.48487758 ICF_3 TestArticle 802 14801 1405 5.140037172 36.33892161 9.006176305 ICF_1 TestArticlePurity 3 5 16 37.5 15.78947368 22.22222222 ICF_2 TestArticlePurity 3 5 16 37.5 15.78947368 22.22222222 ICF_3 TestArticlePurity 5 5 14 50 26.31578947 34.48275862 ICF_1 TimeAtDose 2 332 54 0.598802395 3.571428571 1.025641026 ICF_2 TimeAtDose 2 339 54 0.586510264 3.571428571 1.007556675 ICF_3 TimeAtDose 2 340 54 0.584795322 3.571428571 1.005025126 ICF_2 TimeAtFirstDose 0 82 66 0 0 0 ICF_1 TimeAtFirstDose 1 79 65 1.25 1.515151515 1.369863014 ICF_3 TimeAtFirstDose 1 83 65 1.19047619 1.515151515 1.333333333 ICF_1 TimeAtLastDose 0 51 44 0 0 0 ICF_2 TimeAtLastDose 0 53 44 0 0 0 ICF_3 TimeAtLastDose 0 53 44 0 0 0 ICF_1 TimeEndpointAssessed 87 2147 743 3.894359893 10.48192771 5.678851175 ICF_2 TimeEndpointAssessed 87 2178 743 3.841059603 10.48192771 5.621970921 ICF_3 TimeEndpointAssessed 87 2191 743 3.819139596 10.48192771 5.598455598 ICF_1 TimeUnits 441 1670 292 20.89057319 60.16371078 31.01265823 ICF_2 TimeUnits 451 1671 282 21.2535344 61.52796726 31.59369527 ICF_3 TimeUnits 452 1679 281 21.2106992 61.66439291 31.56424581 ICF_3 Vehicle 233 842 125 21.6744186 65.08379888 32.51919051 ICF_1 Vehicle 235 832 123 22.02436739 65.6424581 32.98245614 ICF_2 Vehicle 236 835 122 22.03548086 65.92178771 33.03009097