====================================================
TAC KBP 2016 BELIEF AND SENTIMENT EVALUATION RESULTS
====================================================


Team ID:  CUBISM
Organization:  IHMC, SUNY/Albany, U. Florida


*************************************************************

Run ID:  CUBISM1
Did the run access the live Web during the evaluation window:  No

Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere).
Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned).

Condition			Belief			Sentiment		All
			Prec	Recall	F1	Prec	Recall	F1	Prec	Recall	F1
cmn-df-gold-ere		0.6875	0.6715	0.6794	0.0673	0.0926	0.0779	0.5231	0.5537	0.5380
cmn-df-pred-ere		1.0000	0.0000	0.0000	0.0323	0.0109	0.0164	0.0323	0.0025	0.0046
cmn-nw-gold-ere		0.7507	0.5139	0.6101	0.0188	0.0541	0.0279	0.6333	0.4939	0.5550
cmn-nw-pred-ere		1.0000	0.0000	0.0000	0.0296	0.0278	0.0287	0.0296	0.0015	0.0028
eng-df-gold-ere		0.6821	0.5912	0.6334	0.1390	0.1659	0.1513	0.4908	0.4709	0.4806
eng-df-pred-ere		1.0000	0.0000	0.0000	1.0000	0.0000	0.0000	1.0000	0.0000	0.0000
eng-nw-gold-ere		0.8142	0.5469	0.6543	0.0466	0.0188	0.0268	0.7537	0.4810	0.5873
eng-nw-pred-ere		1.0000	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000
spa-df-gold-ere		0.5705	0.4976	0.5316	0.1674	0.0428	0.0682	0.5213	0.3511	0.4196
spa-df-pred-ere		1.0000	0.0000	0.0000	0.1358	0.0037	0.0071	0.1358	0.0012	0.0023
spa-nw-gold-ere		0.6082	0.4043	0.4857	0.0777	0.0144	0.0243	0.5774	0.3342	0.4234
spa-nw-pred-ere		1.0000	0.0000	0.0000	0.0417	0.0011	0.0021	0.0417	0.0002	0.0004


*************************************************************

Run ID:  CUBISM2
Did the run access the live Web during the evaluation window:  No

Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere).
Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned).

Condition			Belief			Sentiment		All
			Prec	Recall	F1	Prec	Recall	F1	Prec	Recall	F1
eng-df-gold-ere		1.0000	0.0000	0.0000	0.1390	0.1659	0.1513	0.1390	0.0470	0.0703
eng-df-pred-ere		1.0000	0.0000	0.0000	1.0000	0.0000	0.0000	1.0000	0.0000	0.0000
eng-nw-gold-ere		1.0000	0.0000	0.0000	0.0463	0.0208	0.0287	0.0463	0.0026	0.0049
eng-nw-pred-ere		1.0000	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000


*************************************************************

Run ID:  CUBISM3
Did the run access the live Web during the evaluation window:  No

Scores under each evaluation condition: language (cmn, eng, spa), genre (df, nw), input ere (gold-ere, predicted-ere).
Scores were computed using lenient setting (full credit if and only if at least one correct provenance is returned).

Condition			Belief			Sentiment		All
			Prec	Recall	F1	Prec	Recall	F1	Prec	Recall	F1
eng-df-gold-ere		1.0000	0.0000	0.0000	0.1473	0.1550	0.1511	0.1473	0.0439	0.0677
eng-df-pred-ere		1.0000	0.0000	0.0000	1.0000	0.0000	0.0000	1.0000	0.0000	0.0000
eng-nw-gold-ere		1.0000	0.0000	0.0000	0.0466	0.0188	0.0268	0.0466	0.0023	0.0045
eng-nw-pred-ere		1.0000	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000	0.0000