=========================================================================== TAC 2018 SYSTEMATIC REVIEW INFORMATION EXTRACTION TASK 1 EVALUATION RESULTS =========================================================================== Team ID: SciomeNLP Organization(s): Sciome, LLC ************************************************************* Task 1 Results RunID Category TP FP FN Precision Recall F1 SciomeNLP_1 ALL 6778 5805 8341 53.86632758 44.83100734 48.93509494 SciomeNLP_2 ALL 7025 6094 8094 53.54828874 46.46471327 49.75564842 SciomeNLP_3 ALL 7192 7831 7927 47.873261 47.56928368 47.72078827 SciomeNLP_1 CellLine 33 22 58 60 36.26373626 45.20547945 SciomeNLP_2 CellLine 33 22 58 60 36.26373626 45.20547945 SciomeNLP_3 CellLine 33 22 58 60 36.26373626 45.20547945 SciomeNLP_1 Dose 327 250 284 56.67244367 53.5188216 55.05050505 SciomeNLP_2 Dose 327 250 284 56.67244367 53.5188216 55.05050505 SciomeNLP_3 Dose 327 250 284 56.67244367 53.5188216 55.05050505 SciomeNLP_1 DoseDuration 79 73 109 51.97368421 42.0212766 46.47058824 SciomeNLP_2 DoseDuration 79 73 109 51.97368421 42.0212766 46.47058824 SciomeNLP_3 DoseDuration 79 73 109 51.97368421 42.0212766 46.47058824 SciomeNLP_1 DoseDurationUnits 76 81 100 48.40764331 43.18181818 45.64564565 SciomeNLP_2 DoseDurationUnits 76 81 100 48.40764331 43.18181818 45.64564565 SciomeNLP_3 DoseDurationUnits 76 81 100 48.40764331 43.18181818 45.64564565 SciomeNLP_1 DoseFrequency 45 25 61 64.28571429 42.45283019 51.13636364 SciomeNLP_2 DoseFrequency 45 25 61 64.28571429 42.45283019 51.13636364 SciomeNLP_3 DoseFrequency 45 25 61 64.28571429 42.45283019 51.13636364 SciomeNLP_1 DoseRoute 352 253 172 58.18181818 67.17557252 62.35606732 SciomeNLP_2 DoseRoute 352 253 172 58.18181818 67.17557252 62.35606732 SciomeNLP_3 DoseRoute 352 253 172 58.18181818 67.17557252 62.35606732 SciomeNLP_1 DoseUnits 228 226 213 50.22026432 51.70068027 50.94972067 SciomeNLP_2 DoseUnits 228 226 213 50.22026432 51.70068027 50.94972067 SciomeNLP_3 DoseUnits 228 226 213 50.22026432 51.70068027 50.94972067 SciomeNLP_1 Endpoint 2004 2181 1752 47.88530466 53.35463259 50.47223272 SciomeNLP_2 Endpoint 2251 2470 1505 47.68057615 59.93077742 53.10841099 SciomeNLP_3 Endpoint 2418 4207 1338 36.49811321 64.37699681 46.58510741 SciomeNLP_1 EndpointUnitOfMeasure 121 181 577 40.06622517 17.33524355 24.2 SciomeNLP_2 EndpointUnitOfMeasure 121 181 577 40.06622517 17.33524355 24.2 SciomeNLP_3 EndpointUnitOfMeasure 121 181 577 40.06622517 17.33524355 24.2 SciomeNLP_1 GroupName 0 0 1058 0 0 0 SciomeNLP_2 GroupName 0 0 1058 0 0 0 SciomeNLP_3 GroupName 0 0 1058 0 0 0 SciomeNLP_1 GroupSize 301 165 195 64.59227468 60.68548387 62.57796258 SciomeNLP_2 GroupSize 301 165 195 64.59227468 60.68548387 62.57796258 SciomeNLP_3 GroupSize 301 165 195 64.59227468 60.68548387 62.57796258 SciomeNLP_1 SampleSize 13 9 61 59.09090909 17.56756757 27.08333333 SciomeNLP_2 SampleSize 13 9 61 59.09090909 17.56756757 27.08333333 SciomeNLP_3 SampleSize 13 9 61 59.09090909 17.56756757 27.08333333 SciomeNLP_1 Sex 465 139 143 76.98675497 76.48026316 76.73267327 SciomeNLP_2 Sex 465 139 143 76.98675497 76.48026316 76.73267327 SciomeNLP_3 Sex 465 139 143 76.98675497 76.48026316 76.73267327 SciomeNLP_1 Species 1349 317 290 80.97238896 82.30628432 81.63388805 SciomeNLP_2 Species 1349 317 290 80.97238896 82.30628432 81.63388805 SciomeNLP_3 Species 1349 317 290 80.97238896 82.30628432 81.63388805 SciomeNLP_1 Strain 165 97 173 62.97709924 48.81656805 55 SciomeNLP_2 Strain 165 97 173 62.97709924 48.81656805 55 SciomeNLP_3 Strain 165 97 173 62.97709924 48.81656805 55 SciomeNLP_1 TestArticle 670 650 1537 50.75757576 30.35795197 37.9926283 SciomeNLP_2 TestArticle 670 650 1537 50.75757576 30.35795197 37.9926283 SciomeNLP_3 TestArticle 670 650 1537 50.75757576 30.35795197 37.9926283 SciomeNLP_1 TestArticlePurity 0 0 19 0 0 0 SciomeNLP_2 TestArticlePurity 0 0 19 0 0 0 SciomeNLP_3 TestArticlePurity 0 0 19 0 0 0 SciomeNLP_1 TimeAtDose 17 254 39 6.273062731 30.35714286 10.39755352 SciomeNLP_2 TimeAtDose 17 254 39 6.273062731 30.35714286 10.39755352 SciomeNLP_3 TimeAtDose 17 254 39 6.273062731 30.35714286 10.39755352 SciomeNLP_1 TimeAtFirstDose 0 0 66 0 0 0 SciomeNLP_2 TimeAtFirstDose 0 0 66 0 0 0 SciomeNLP_3 TimeAtFirstDose 0 0 66 0 0 0 SciomeNLP_1 TimeAtLastDose 0 0 44 0 0 0 SciomeNLP_2 TimeAtLastDose 0 0 44 0 0 0 SciomeNLP_3 TimeAtLastDose 0 0 44 0 0 0 SciomeNLP_1 TimeEndpointAssessed 0 0 830 0 0 0 SciomeNLP_2 TimeEndpointAssessed 0 0 830 0 0 0 SciomeNLP_3 TimeEndpointAssessed 0 0 830 0 0 0 SciomeNLP_1 TimeUnits 373 468 360 44.35196195 50.88676671 47.39517154 SciomeNLP_2 TimeUnits 373 468 360 44.35196195 50.88676671 47.39517154 SciomeNLP_3 TimeUnits 373 468 360 44.35196195 50.88676671 47.39517154 SciomeNLP_1 Vehicle 160 414 198 27.87456446 44.69273743 34.33476395 SciomeNLP_2 Vehicle 160 414 198 27.87456446 44.69273743 34.33476395 SciomeNLP_3 Vehicle 160 414 198 27.87456446 44.69273743 34.33476395