TAC 2016 Tracks
Cold Start SF/KB
TAC 2016 Workshop
TAC KBP 2016 Validation/Ensembling Track
The slot filler validation (SFV) task of the Validation/Ensembling track focuses on the refinement of output from English slot filling (SF) systems by either combining information from multiple slot filling systems, or applying more intensive linguistic processing to validate individual candidate slot fillers.
SFV is a diagnostic task that eliminates the need for a team to have a full slot filling system and concentrates on the refinement of existing system(s) output. The input to the SFV system is a set of submission files from Cold Start KB and slot filling runs. The output of the SFV system is a binary classification (Correct/Incorrect) of each candidate slot filler in each SF run.
For the SFV Ensemble task, the evaluation considers the SFV run as a single ensemble Cold Start SF run that includes only selected slot fillers from the input Cold Start SF runs; the objective function for the SFV Ensemble task is to maximize the F-score of the ensemble Cold Start run.
Track CoordinatorHoa Dang (NIST, firstname.lastname@example.org)
NIST is an agency of the
U.S. Department of Commerce
Last updated: Tuesday, 28-Mar-2017 09:22:20 MDT
Comments to: email@example.com