====================================================
TAC KBP 2017 BELIEF AND SENTIMENT EVALUATION RESULTS
====================================================


Team ID:  CornMich
Organization:  Cornell-Michigan


*************************************************************

Run ID:  CornMich_sys1
Did the run access the live Web during the evaluation window:  No

Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere).
Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned).

Condition			Belief			Sentiment		All
			Prec	Recall	F1	Prec	Recall	F1	Prec	Recall	F1
cmn-df-gold-ere		0.8193	0.8116	0.8154	0.3580	0.2205	0.2729	0.7750	0.7253	0.7493
cmn-df-pred-ere		0.0107	0.0025	0.0041	0.0818	0.0128	0.0221	0.0184	0.0041	0.0067
cmn-nw-gold-ere		0.8586	0.5096	0.6396	0.1628	0.1265	0.1424	0.8156	0.4912	0.6131
cmn-nw-pred-ere		0.0103	0.0018	0.0030	0.0816	0.0135	0.0232	0.0134	0.0023	0.0039


*************************************************************

Run ID:  CornMich_sys2
Did the run access the live Web during the evaluation window:  No

Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere).
Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned).

Condition			Belief			Sentiment		All
			Prec	Recall	F1	Prec	Recall	F1	Prec	Recall	F1
cmn-df-gold-ere		0.8193	0.8116	0.8154	0.3724	0.2205	0.2769	0.7779	0.7253	0.7506
cmn-df-pred-ere		0.0107	0.0025	0.0041	0.0841	0.0128	0.0222	0.0184	0.0041	0.0067
cmn-nw-gold-ere		0.8586	0.5096	0.6396	0.1841	0.1176	0.1435	0.8239	0.4908	0.6151
cmn-nw-pred-ere		0.0103	0.0018	0.0030	0.0857	0.0101	0.0181	0.0127	0.0022	0.0037


*************************************************************

Run ID:  CornMich_sys3
Did the run access the live Web during the evaluation window:  No

Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere).
Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned).

Condition			Belief			Sentiment		All
			Prec	Recall	F1	Prec	Recall	F1	Prec	Recall	F1
cmn-df-gold-ere		0.8193	0.8116	0.8154	0.2960	0.2568	0.2750	0.7512	0.7306	0.7407
cmn-df-pred-ere		0.0107	0.0025	0.0041	0.0894	0.0216	0.0348	0.0231	0.0055	0.0088
cmn-nw-gold-ere		0.8586	0.5096	0.6396	0.1497	0.1310	0.1397	0.8096	0.4914	0.6116
cmn-nw-pred-ere		0.0103	0.0018	0.0030	0.0625	0.0135	0.0222	0.0132	0.0023	0.0039