=======================================================
TAC KBP 2015 COLD START SLOT FILLING EVALUATION RESULTS
=======================================================


Team ID:  ZJU_DCD_SF
Organization:  Zhejiang University-Digital Media Computing & Design Lab


*************************************************************

Run ID:  ZJU_DCD_SF1
Did the run access the live Web during the evaluation window:  No
Run Number of most similar Cold Start KB Construction task submission: NA
Did the run extract relations from the Cold Start source corpus: Yes
Did the run generate meaningful confidence values: No


Slot Filling Evaluation:

Metric		Hop	GoldT	Submit	Correct	Incorrect	Inexact	PIncorrect	Dup	Right	Wrong	Prec	Recall	F1
CSSF micro	0	4840	2047	258	1749		40	0		19	239	1808	0.1168	0.0494	0.0694
CSSF micro	1	3954	1108	5	139		0	964		0	5	1103	0.0045	0.0013	0.0020
CSSF micro	ALL	8794	3155	263	1888		40	964		19	244	2911	0.0773	0.0277	0.0408
LDC-MEAN macro	0														0.0592
LDC-MEAN macro	1														0.0036
LDC-MEAN macro	ALL														0.0393
LDC-MAX micro	0	1268	544	83	448		13	0		4	79	465	0.1452	0.0623	0.0872
LDC-MAX micro	1	900	280	3	39		0	238		0	3	277	0.0107	0.0033	0.0051
LDC-MAX micro	ALL	2168	824	86	487		13	238		4	82	742	0.0995	0.0378	0.0548
LDC-MAX macro	0														0.0788
LDC-MAX macro	1														0.0066
LDC-MAX macro	ALL														0.0530


*************************************************************

Run ID:  ZJU_DCD_SF2
Did the run access the live Web during the evaluation window:  No
Run Number of most similar Cold Start KB Construction task submission: NA
Did the run extract relations from the Cold Start source corpus: Yes
Did the run generate meaningful confidence values: No


Slot Filling Evaluation:

Metric		Hop	GoldT	Submit	Correct	Incorrect	Inexact	PIncorrect	Dup	Right	Wrong	Prec	Recall	F1
CSSF micro	0	4840	1616	180	1373		63	0		1	179	1437	0.1108	0.0370	0.0555
CSSF micro	1	3954	675	0	77		0	598		0	0	675	0.0000	0.0000	0.0000
CSSF micro	ALL	8794	2291	180	1450		63	598		1	179	2112	0.0781	0.0204	0.0323
LDC-MEAN macro	0														0.0708
LDC-MEAN macro	1														0.0000
LDC-MEAN macro	ALL														0.0454
LDC-MAX micro	0	1268	426	65	346		15	0		1	64	362	0.1502	0.0505	0.0756
LDC-MAX micro	1	900	168	0	21		0	147		0	0	168	0.0000	0.0000	0.0000
LDC-MAX micro	ALL	2168	594	65	367		15	147		1	64	530	0.1077	0.0295	0.0463
LDC-MAX macro	0														0.0899
LDC-MAX macro	1														0.0000
LDC-MAX macro	ALL														0.0577