KBP 2012 Cold Start Tools
- Validator for Cold Start 2012 submission file (V1.2): ValidateColdStart.pl (August 20, 2012)
- ResolveQueries.pl (November 13, 2012)
- Pool.pl (November 13, 2012)
- Cold Start Scorer (V1.1): CSScore.java (October 16, 2012)
KBP 2012 Entity-Linking Tools
- Validator for KBP 2012 English Entity-Linking submission file: check_kbp2012_english-entity-linking.pl (August 28, 2012)
- Validator for KBP 2012 Chinese Entity-Linking submission file: check_kbp2012_chinese-entity-linking.pl (August 28, 2012)
- Validator for KBP 2012 Spanish Entity-Linking submission file: check_kbp2012_spanish-entity-linking.pl (August 28, 2012)
KBP 2012 Slot-Filling Tools
- Validator for KBP 2012 Slot-Filling submission file (V1.1): check_kbp_slot-filling.pl (July 24, 2012)
- usage: check_kbp_slot-filling.pl docid-list queries-xml-file submission_file
- sample docid list file: tac_2012_kbp_spanish_slot_filling_sample_doclist.txt
- sample queries xml file: tac_2012_kbp_spanish_slot_filling_sample_queries.xml
- sample submission file: tac_2012_kbp_spanish_slot_filling_sample_submission.txt
- KBP 2012 Regular Slot-Filling scorer: SFScore.java (v1.3) (September 20, 2012)
- usage: java SFScore submission_file assessment_file slots=KBP2012_english_SF_slot-list trace
- submission_file is the submission file
- assessment_file is the concatenation of the assessment result files from LDC2012E115
- KBP2012_english_SF_slot-list is a file listing all the entityId:slot pairs in the evaluation, taken from the names of the assessment result files in LDC2012E115
KBP 2011 Entity-Linking Tools
- Validator for KBP 2011 English Entity-Linking submission file: check_kbp_2011_english-entity-linking.pl
- Validator for KBP 2011 Chinese Cross-Lingual Entity-Linking submission file: check_kbp_2011_cross-lingual-entity-linking.pl
- KBP 2011 English/Cross-Lingual Entity-Linking scorer: el_scorer.py
KBP 2011 Regular English Slot-Filling Tools
- Validator for KBP 2011 Regular English Slot-Filling submission file: check_kbp_2011_slot-filling.pl
- usage: check_kbp_2011_slot-filling.pl submission_file
- submission_file is the submission file, e.g., tac_2011_kbp_english_evaluation_regular_slot_filling_submission.txt (from LDC2011E89)
- KBP 2011 Regular Slot-Filling scorer: SFScore.java (v1.2)
- usage: java SFScore submission_file assessment_file
- submission_file is the submission file
- assessment_file is the concatenation of the assessment result files (from LDC2011E88)
 | BACK to TAC KBP 2012 Home page |