TAC 2019 Tracks
SM-KBP
Guidelines
Data
Tools
EDL
DDI
Call for Participation
Track Registration
Reporting Guidelines
TAC 2019 Workshop
TAC KBP 2019 Data
Data that are required for the TAC 2019 tracks are distributed at no cost to track participants. Whenever possible, data are distributed by NIST or the Linguistic Data Consortium via Web download; data are mailed as physical disks only if they cannot be made available for download.
Access to TAC 2019 data is restricted to registered TAC 2019 participants who have submitted all the required User Agreement forms. Each participating team will provide a TAC 2019 Team ID and will receive a Team Password upon registration. Teams that have participated in past TAC evaluations must register and obtain a new TAC 2019 Team ID and password for 2019. Teams must also submit new (current) User Agreement forms for 2019. Once the required User Agreement forms have been received for that team, NIST will activate the TAC 2019 Team ID and Password to give access to password-protected TAC 2019 resources that are distributed by NIST (a different username and password are required for data that are downloaded from LDC's intranet).
Data resources from past KBP and related evaluations listed in the 2019 Text Analysis Conference (TAC) Evaluation License Agreement are available for system development and must be requested by name and catalog number from the LDC upon registration; teams are responsible for requesting the past data that are relevant for their respective tracks when submitting the Evaluation License Agreement to the LDC.
In addition to resources listed in the 2019 Text Analysis Conference (TAC) Evaluation License Agreement, the following KBP 2019 development data and evaluation data are available to KBP 2019 teams:
- SM-KBP Track
- LDC2018E80: LORELEI Background KB (Download from LDC)
- LDC2018E77: LORELEI Representative Language EDL Knowledge Base (Download from LDC)
- LDC2019E01: LORELEI English Source Data and Annotation (Download from LDC)
- LDC2019E04: AIDA Phase 1 Eval Practice Topic Source Data V2.0 (Download from LDC)
- LDC2019E05: AIDA Phase 1 Evaluation Annotation Format Sample (Download from LDC)
- LDC2019E07: AIDA Phase 1 Evaluation Practice Topic Annotations V8.0 (Download from LDC)
- LDC2019E44: AIDA Phase 1 Practice Topics Reference Knowledge Base V1.0 (Download from LDC)
- LDC2019E42: AIDA Phase 1 Evaluation Source Data (encrypted with key K1) (Download from LDC)
- Auxiliary files for Query Response Validator for LDC2019E42 V1.1
- parent_children.ttl file for LDC2019E42 (encrypted with key K1)
- LDC2019E43: AIDA Phase 1 Evaluation Reference Knowledge Base (encrypted with key K2) (Download from LDC)
- RDF version of Evaluation Reference KB in LDC2019E43 (encrypted with key K2)
- duplicate entries in LDC2019E43 for the same entity
- AIDA_Phase1_Evaluation_Decryption_Keys.txt
- AIDA Phase1 Evaluation Task1b Feedback Hypotheses
- AIDA Phase1 Evaluation Task3 Information Need
- AIDA Phase1 Evaluation Task3b LDC Annotations in AIF
- LDC2019E77: AIDA Phase 1 Evaluation Topic Annotations - Unsequestered V2.0(Download from LDC)
- LDC2019E80: AIDA_Phase 1 Assessment Results - Unsequestered (Download from LDC)
- AIDA Phase1 Evaluation Queries V8