============================================================================= TAC 2017 ADVERSE DRUG REACTION EXTRACTION FROM DRUG LABELS EVALUATION RESULTS ============================================================================= Team ID: UTH_CCB Organization: The University of Texas Health Science Center at Houston ************************************************************* Run ID: UTH_CCB1 -------------------------------------------------- Task 1 Results: Exact (+type) TP: 11623 FP: 2251 FN: 2954 Precision: 83.78 Recall: 79.74 F1: 81.71 (PRIMARY) Exact (-type) TP: 11631 FP: 2243 FN: 2946 Precision: 83.83 Recall: 79.79 F1: 81.76 -------------------------------------------------- Task 2 Results: Full (+type) TP: 1161 FP: 1086 FN: 1451 Precision: 51.67 Recall: 44.45 F1: 47.79 (PRIMARY) Full (-type) TP: 1173 FP: 1074 FN: 1439 Precision: 52.20 Recall: 44.91 F1: 48.28 Binary (+type) TP: 1501 FP: 1203 FN: 1450 Precision: 55.51 Recall: 50.86 F1: 53.09 Binary (-type) TP: 1514 FP: 1190 FN: 1437 Precision: 55.99 Recall: 51.30 F1: 53.55 -------------------------------------------------- Task 3 Results: TP: 5186 FP: 1075 FN: 1157 Micro-Precision: 82.83 Micro-Recall: 81.76 Micro-F1: 82.29 Macro-Precision 82.61 Macro-Recall 81.88 Macro-F1 81.65 (PRIMARY) -------------------------------------------------- Task 4 Results: TP: 4550 FP: 803 FN: 635 Micro-Precision: 85.00 Micro-Recall: 87.75 Micro-F1: 86.35 Macro-Precision 84.04 Macro-Recall 86.67 Macro-F1 84.79 (PRIMARY) ************************************************************* Run ID: UTH_CCB2 -------------------------------------------------- Task 1 Results: Exact (+type) TP: 12303 FP: 3034 FN: 2274 Precision: 80.22 Recall: 84.40 F1: 82.26 (PRIMARY) Exact (-type) TP: 12306 FP: 3029 FN: 2271 Precision: 80.25 Recall: 84.42 F1: 82.28 -------------------------------------------------- Task 2 Results: Full (+type) TP: 1262 FP: 1467 FN: 1350 Precision: 46.24 Recall: 48.32 F1: 47.26 (PRIMARY) Full (-type) TP: 1271 FP: 1458 FN: 1341 Precision: 46.57 Recall: 48.66 F1: 47.59 Binary (+type) TP: 1674 FP: 1661 FN: 1277 Precision: 50.19 Recall: 56.73 F1: 53.26 Binary (-type) TP: 1685 FP: 1650 FN: 1266 Precision: 50.52 Recall: 57.10 F1: 53.61 -------------------------------------------------- Task 3 Results: TP: 5428 FP: 1384 FN: 915 Micro-Precision: 79.68 Micro-Recall: 85.57 Micro-F1: 82.52 Macro-Precision 78.77 Macro-Recall 85.62 Macro-F1 81.39 (PRIMARY) -------------------------------------------------- Task 4 Results: TP: 4707 FP: 1004 FN: 478 Micro-Precision: 82.42 Micro-Recall: 90.78 Micro-F1: 86.40 Macro-Precision 80.83 Macro-Recall 89.90 Macro-F1 84.53 (PRIMARY) ************************************************************* Run ID: UTH_CCB3 -------------------------------------------------- Task 1 Results: Exact (+type) TP: 12015 FP: 2542 FN: 2562 Precision: 82.54 Recall: 82.42 F1: 82.48 (PRIMARY) Exact (-type) TP: 12023 FP: 2534 FN: 2554 Precision: 82.59 Recall: 82.48 F1: 82.54 -------------------------------------------------- Task 2 Results: Full (+type) TP: 1249 FP: 1237 FN: 1363 Precision: 50.24 Recall: 47.82 F1: 49.00 (PRIMARY) Full (-type) TP: 1261 FP: 1225 FN: 1351 Precision: 50.72 Recall: 48.28 F1: 49.47 Binary (+type) TP: 1608 FP: 1374 FN: 1343 Precision: 53.92 Recall: 54.49 F1: 54.21 Binary (-type) TP: 1621 FP: 1361 FN: 1330 Precision: 54.36 Recall: 54.93 F1: 54.64 -------------------------------------------------- Task 3 Results: TP: 5383 FP: 1265 FN: 960 Micro-Precision: 80.97 Micro-Recall: 84.87 Micro-F1: 82.87 Macro-Precision 80.69 Macro-Recall 85.05 Macro-F1 82.19 (PRIMARY) -------------------------------------------------- Task 4 Results: TP: 4658 FP: 876 FN: 527 Micro-Precision: 84.17 Micro-Recall: 89.84 Micro-F1: 86.91 Macro-Precision 83.02 Macro-Recall 89.06 Macro-F1 85.33 (PRIMARY)