=============================================================================
TAC 2017 ADVERSE DRUG REACTION EXTRACTION FROM DRUG LABELS EVALUATION RESULTS
=============================================================================


Team ID:  PRNA_SUNY
Organization:  Philips Research North America - University at Albany, SUNY


*************************************************************

Run ID:  PRNA_SUNY1
--------------------------------------------------
Task 1 Results:
  Exact (+type)
    TP: 9315  FP: 2672  FN: 5262
    Precision: 77.71
    Recall:    63.90
    F1:        70.13  (PRIMARY)
  Exact (-type)
    TP: 9317  FP: 2670  FN: 5260
    Precision: 77.73
    Recall:    63.92
    F1:        70.15  
--------------------------------------------------
Task 2 Results:
  Full (+type)
    TP: 584  FP: 573  FN: 2028
    Precision: 50.48
    Recall:    22.36
    F1:        30.99  (PRIMARY)
  Full (-type)
    TP: 589  FP: 568  FN: 2023
    Precision: 50.91
    Recall:    22.55
    F1:        31.25  
  Binary (+type)
    TP: 730  FP: 559  FN: 2221
    Precision: 56.63
    Recall:    24.74
    F1:        34.43  
  Binary (-type)
    TP: 735  FP: 554  FN: 2216
    Precision: 57.02
    Recall:    24.91
    F1:        34.67  
--------------------------------------------------
Task 3 Results:
    TP: 4434  FP: 1636  FN: 1909
    Micro-Precision: 73.05
    Micro-Recall:    69.90
    Micro-F1:        71.44
    Macro-Precision  73.23
    Macro-Recall     68.91
    Macro-F1         70.29  (PRIMARY)
--------------------------------------------------
Task 4 Results:
    TP: 3883  FP: 625  FN: 1302
    Micro-Precision: 86.14
    Micro-Recall:    74.89
    Micro-F1:        80.12
    Macro-Precision  85.32
    Macro-Recall     72.76
    Macro-F1         77.97  (PRIMARY)


*************************************************************

Run ID:  PRNA_SUNY2
--------------------------------------------------
Task 1 Results:
  Exact (+type)
    TP: 8976  FP: 4994  FN: 5601
    Precision: 64.25
    Recall:    61.58
    F1:        62.89  (PRIMARY)
  Exact (-type)
    TP: 8995  FP: 4975  FN: 5582
    Precision: 64.39
    Recall:    61.71
    F1:        63.02  
--------------------------------------------------
Task 2 Results:
  Full (+type)
    TP: 244  FP: 536  FN: 2368
    Precision: 31.28
    Recall:    9.34
    F1:        14.39  (PRIMARY)
  Full (-type)
    TP: 249  FP: 531  FN: 2363
    Precision: 31.92
    Recall:    9.53
    F1:        14.68  
  Binary (+type)
    TP: 304  FP: 553  FN: 2647
    Precision: 35.47
    Recall:    10.30
    F1:        15.97  
  Binary (-type)
    TP: 309  FP: 548  FN: 2642
    Precision: 36.06
    Recall:    10.47
    F1:        16.23  
--------------------------------------------------
Task 3 Results:
    TP: 4561  FP: 3095  FN: 1782
    Micro-Precision: 59.57
    Micro-Recall:    71.91
    Micro-F1:        65.16
    Macro-Precision  58.16
    Macro-Recall     70.96
    Macro-F1         63.25  (PRIMARY)
--------------------------------------------------
Task 4 Results:
    TP: 4057  FP: 918  FN: 1128
    Micro-Precision: 81.55
    Micro-Recall:    78.24
    Micro-F1:        79.86
    Macro-Precision  79.80
    Macro-Recall     76.03
    Macro-F1         77.25  (PRIMARY)


*************************************************************

Run ID:  PRNA_SUNY3
--------------------------------------------------
Task 1 Results:
  Exact (+type)
    TP: 9315  FP: 2672  FN: 5262
    Precision: 77.71
    Recall:    63.90
    F1:        70.13  (PRIMARY)
  Exact (-type)
    TP: 9317  FP: 2670  FN: 5260
    Precision: 77.73
    Recall:    63.92
    F1:        70.15  
--------------------------------------------------
Task 2 Results:
  Full (+type)
    TP: 584  FP: 573  FN: 2028
    Precision: 50.48
    Recall:    22.36
    F1:        30.99  (PRIMARY)
  Full (-type)
    TP: 589  FP: 568  FN: 2023
    Precision: 50.91
    Recall:    22.55
    F1:        31.25  
  Binary (+type)
    TP: 730  FP: 559  FN: 2221
    Precision: 56.63
    Recall:    24.74
    F1:        34.43  
  Binary (-type)
    TP: 735  FP: 554  FN: 2216
    Precision: 57.02
    Recall:    24.91
    F1:        34.67  
--------------------------------------------------
Task 3 Results:
    TP: 4434  FP: 1636  FN: 1909
    Micro-Precision: 73.05
    Micro-Recall:    69.90
    Micro-F1:        71.44
    Macro-Precision  73.23
    Macro-Recall     68.91
    Macro-F1         70.29  (PRIMARY)
--------------------------------------------------
Task 4 Results:
    TP: 3844  FP: 754  FN: 1341
    Micro-Precision: 83.60
    Micro-Recall:    74.14
    Micro-F1:        78.59
    Macro-Precision  82.22
    Macro-Recall     71.44
    Macro-F1         75.87  (PRIMARY)