TAC 2010
Knowledge Base Population (KBP2010) Track
KBP 2010 slot filling utilities by Ralph Grishman:
KBP 2010 evaluation Submission Validation Tool
CheckSFResponse.java to validate submission format.
Key File Validation tool
CheckSFKey.java
(ver. 1.1) makes basic checks on the
format of a 2010 key file for slot filling. To run,
javac CheckSFKey.java
java CheckSFKey key-file
Conversion tools (2009 to 2010)
UpdateSFKey
(ver 1.0) converts a 2009-format key file to a 2010-format key
file. Slot names are not updated. To run,
javac UpdateSFKey.java
java UpdateSFKey 2009-key-file 2010-key-file
UpdateSFResponse
(ver 1.0) converts a 2009-format response file to a 2010-format
response file. Slot names are not updated. This is of
interest only to KBP old-timers with 2009 response files.
javac UpdateSFResponse.java
java UpdateSFResponse 2009-response-file 2010-response-file
Key File analysis tool
KeyStats
(ver. 1.0) displays statistics on the frequency of different slots in a
key file.
javac KeyStats.java
java KeyStats key-file
Annotation tool by CUNY
An annotation tool by Zheng Chen (CUNY) is available for
participant annotation. Please contact Heng Ji <hengji@cs.qc.cuny.edu> to
obtain the tool.
Format Validation Tools from KBP 2009:
Validate entity linking submissions:
check_kbp_entity-linking.pl.
Validate slot filling submissions:
check_kbp_slot-filling.pl
|
