=============================================================================
TAC 2018 DRUG-DRUG INTERACTION EXTRACTION FROM DRUG LABELS EVALUATION RESULTS
=============================================================================


Team ID:  ttran
Organization(s):  University of Kentucky; National Library of Medicine


*************************************************************
Run: ttran1
Test Set 1 Results
--------------------------------------------------
Task 1 Results:
  Exact (+type)
    TP: 2281  FP: 5414  FN: 4942
    Precision: 29.64
    Recall:    31.58
    F1:        30.58  (PRIMARY)
  Exact (-type)
    TP: 2301  FP: 5394  FN: 4921
    Precision: 29.90
    Recall:    31.86
    F1:        30.85  
--------------------------------------------------
Task 2 Results:
  Full (+type)
    TP: 773  FP: 2860  FN: 3501
    Precision: 21.28
    Recall:    18.09
    F1:        19.55  (PRIMARY)
  Full (-type)
    TP: 773  FP: 2860  FN: 3501
    Precision: 21.28
    Recall:    18.09
    F1:        19.55  
  Binary (+type)
    TP: 1037  FP: 2556  FN: 3019
    Precision: 28.86
    Recall:    25.57
    F1:        27.11  
  Binary (-type)
    TP: 1371  FP: 2222  FN: 2685
    Precision: 38.16
    Recall:    33.80
    F1:        35.85  


*************************************************************
Run: ttran1
Test Set 2 Results 
--------------------------------------------------
Task 1 Results:
  Exact (+type)
    TP: 1182  FP: 2167  FN: 2349
    Precision: 35.29
    Recall:    33.47
    F1:        34.36  (PRIMARY)
  Exact (-type)
    TP: 1205  FP: 2144  FN: 2326
    Precision: 35.98
    Recall:    34.13
    F1:        35.03  
--------------------------------------------------
Task 2 Results:
  Full (+type)
    TP: 382  FP: 1315  FN: 1775
    Precision: 22.51
    Recall:    17.71
    F1:        19.82  (PRIMARY)
  Full (-type)
    TP: 382  FP: 1315  FN: 1775
    Precision: 22.51
    Recall:    17.71
    F1:        19.82  
  Binary (+type)
    TP: 595  FP: 1021  FN: 1334
    Precision: 36.82
    Recall:    30.84
    F1:        33.57  
  Binary (-type)
    TP: 726  FP: 890  FN: 1203
    Precision: 44.93
    Recall:    37.64
    F1:        40.96  


*************************************************************
Run: ttran2
Test Set 1 Results
--------------------------------------------------
Task 1 Results:
  Exact (+type)
    TP: 2705  FP: 6466  FN: 4518
    Precision: 29.50
    Recall:    37.45
    F1:        33.00  (PRIMARY)
  Exact (-type)
    TP: 2733  FP: 6438  FN: 4489
    Precision: 29.80
    Recall:    37.84
    F1:        33.34  
--------------------------------------------------
Task 2 Results:
  Full (+type)
    TP: 903  FP: 3187  FN: 3371
    Precision: 22.08
    Recall:    21.13
    F1:        21.59  (PRIMARY)
  Full (-type)
    TP: 903  FP: 3187  FN: 3371
    Precision: 22.08
    Recall:    21.13
    F1:        21.59  
  Binary (+type)
    TP: 1185  FP: 2652  FN: 2871
    Precision: 30.88
    Recall:    29.22
    F1:        30.03  
  Binary (-type)
    TP: 1556  FP: 2281  FN: 2500
    Precision: 40.55
    Recall:    38.36
    F1:        39.43  


*************************************************************
Run: ttran2
Test Set 2 Results 
--------------------------------------------------
Task 1 Results:
  Exact (+type)
    TP: 1413  FP: 2439  FN: 2118
    Precision: 36.68
    Recall:    40.02
    F1:        38.28  (PRIMARY)
  Exact (-type)
    TP: 1440  FP: 2412  FN: 2091
    Precision: 37.38
    Recall:    40.78
    F1:        39.01  
--------------------------------------------------
Task 2 Results:
  Full (+type)
    TP: 486  FP: 1485  FN: 1671
    Precision: 24.66
    Recall:    22.53
    F1:        23.55  (PRIMARY)
  Full (-type)
    TP: 486  FP: 1485  FN: 1671
    Precision: 24.66
    Recall:    22.53
    F1:        23.55  
  Binary (+type)
    TP: 685  FP: 1040  FN: 1244
    Precision: 39.71
    Recall:    35.51
    F1:        37.49  
  Binary (-type)
    TP: 854  FP: 871  FN: 1075
    Precision: 49.51
    Recall:    44.27
    F1:        46.74  


*************************************************************
Run: ttran3
Test Set 1 Results
--------------------------------------------------
Task 1 Results:
  Exact (+type)
    TP: 1985  FP: 4948  FN: 5238
    Precision: 28.63
    Recall:    27.48
    F1:        28.04  (PRIMARY)
  Exact (-type)
    TP: 2007  FP: 4926  FN: 5215
    Precision: 28.95
    Recall:    27.79
    F1:        28.36  
--------------------------------------------------
Task 2 Results:
  Full (+type)
    TP: 708  FP: 2519  FN: 3566
    Precision: 21.94
    Recall:    16.57
    F1:        18.88  (PRIMARY)
  Full (-type)
    TP: 708  FP: 2519  FN: 3566
    Precision: 21.94
    Recall:    16.57
    F1:        18.88  
  Binary (+type)
    TP: 921  FP: 2266  FN: 3135
    Precision: 28.90
    Recall:    22.71
    F1:        25.43  
  Binary (-type)
    TP: 1242  FP: 1945  FN: 2814
    Precision: 38.97
    Recall:    30.62
    F1:        34.30  


*************************************************************
Run: ttran3
Test Set 2 Results 
--------------------------------------------------
Task 1 Results:
  Exact (+type)
    TP: 1071  FP: 1996  FN: 2460
    Precision: 34.92
    Recall:    30.33
    F1:        32.46  (PRIMARY)
  Exact (-type)
    TP: 1098  FP: 1969  FN: 2433
    Precision: 35.80
    Recall:    31.10
    F1:        33.28  
--------------------------------------------------
Task 2 Results:
  Full (+type)
    TP: 338  FP: 1242  FN: 1819
    Precision: 21.39
    Recall:    15.67
    F1:        18.09  (PRIMARY)
  Full (-type)
    TP: 338  FP: 1242  FN: 1819
    Precision: 21.39
    Recall:    15.67
    F1:        18.09  
  Binary (+type)
    TP: 554  FP: 938  FN: 1375
    Precision: 37.13
    Recall:    28.72
    F1:        32.39  
  Binary (-type)
    TP: 697  FP: 795  FN: 1232
    Precision: 46.72
    Recall:    36.13
    F1:        40.75