KBP 2012 Cold Start Tools
Validator for Cold Start 2012 submission file (V1.2):
ValidateColdStart.pl
(August 20, 2012)
ResolveQueries.pl
(November 13, 2012)
Pool.pl
(November 13, 2012)
Cold Start Scorer (V1.1):
CSScore.java
(October 16, 2012)
KBP 2012 Entity-Linking Tools
Validator for KBP 2012 English Entity-Linking submission file:
check_kbp2012_english-entity-linking.pl
(August 28, 2012)
Validator for KBP 2012 Chinese Entity-Linking submission file:
check_kbp2012_chinese-entity-linking.pl
(August 28, 2012)
Validator for KBP 2012 Spanish Entity-Linking submission file:
check_kbp2012_spanish-entity-linking.pl
(August 28, 2012)
KBP 2012 Slot-Filling Tools
Validator for KBP 2012 Slot-Filling submission file (V1.1):
check_kbp_slot-filling.pl
(July 24, 2012)
usage: check_kbp_slot-filling.pl
docid-list queries-xml-file submission_file
sample docid list file:
tac_2012_kbp_spanish_slot_filling_sample_doclist.txt
sample queries xml file:
tac_2012_kbp_spanish_slot_filling_sample_queries.xml
sample submission file:
tac_2012_kbp_spanish_slot_filling_sample_submission.txt
KBP 2012 Regular Slot-Filling scorer:
SFScore.java (v1.3)
(September 20, 2012)
usage: java SFScore
submission_file
assessment_file
slots=KBP2012_english_SF_slot-list trace
submission_file
is the submission file
assessment_file
is the concatenation of the assessment result files from LDC2012E115
KBP2012_english_SF_slot-list
is a file listing all the entityId:slot pairs in the evaluation, taken from the names of the assessment result files in LDC2012E115
KBP 2011 Entity-Linking Tools
Validator for KBP 2011 English Entity-Linking submission file:
check_kbp_2011_english-entity-linking.pl
Validator for KBP 2011 Chinese Cross-Lingual Entity-Linking submission file:
check_kbp_2011_cross-lingual-entity-linking.pl
KBP 2011 English/Cross-Lingual Entity-Linking scorer:
el_scorer.py
KBP 2011 Regular English Slot-Filling Tools
Validator for KBP 2011 Regular English Slot-Filling submission file:
check_kbp_2011_slot-filling.pl
usage: check_kbp_2011_slot-filling.pl
submission_file
submission_file
is the submission file, e.g., tac_2011_kbp_english_evaluation_regular_slot_filling_submission.txt (from LDC2011E89)
KBP 2011 Regular Slot-Filling scorer:
SFScore.java (v1.2)
usage: java SFScore
submission_file
assessment_file
submission_file
is the submission file
assessment_file
is the concatenation of the assessment result files (from LDC2011E88)
BACK to TAC KBP 2012 Home page
Last updated:
Comments to:
[email protected]