TAC KBP 2016 Data

Data that are required for the TAC KBP 2016 tracks are distributed at no cost to track participants. Whenever possible, data are distributed by NIST or the Linguistic Data Consortium via Web download; data are mailed as physical disks only if they cannot be made available for download.

Access to TAC KBP 2016 data is restricted to registered TAC KBP 2016 participants who have submitted all the required User Agreement forms. Each participating team will provide a TAC KBP 2016 Team ID and will receive a Team Password upon registration. Teams that have participated in past TAC evaluations must register and obtain a new TAC KBP 2016 Team ID and password for 2016. Teams must also submit new (current) User Agreement forms for 2016. Once the required User Agreement forms have been received for that team, NIST will activate the TAC KBP 2016 Team ID and Password to give access to password-protected KBP 2016 resources that are distributed by NIST (a different username and password are required for data that are downloaded from LDC's intranet).

Data resources from past KBP evaluations listed in the 2016 Text Analysis Conference (TAC) Knowledge Base Population Evaluation License Agreement are available for system development and must be requested by name and catalog number from the LDC upon registration; teams are responsible for requesting the past KBP data that are relevant for their respective tracks when submitting the Evaluation License Agreement to the LDC.

In addition to KBP resources listed in the 2016 Text Analysis Conference (TAC) Knowledge Base Population Evaluation License Agreement, the following KBP 2016 development data and evaluation data have been distributed to all KBP 2016 teams:

• All KBP Tracks (Source Corpus)
1. LDC2016E63: TAC KBP 2016 Evaluation Source Corpus V1.1 (Download Documentation here and Corpus here) (August 1, 2016)
2. LDC2016E64: TAC KBP 2016 Evaluation Core Source Corpus (Download README here and Corpus here) (September 20, 2016)


• Entity Discovery and Linking Track
1. LDC2016E68: TAC KBP 2016 Entity Discovery and Linking Evaluation Gold Standard Entity Mentions and Knowledge Base Links (Download here)
2. TAC KBP 2016 EDL Evaluation Summary Statistics (Download here)


• Cold Start SF/KB Track
1. LDC2016E41: TAC KBP 2016 Bilingual Spanish-English Cold Start Pilot - Training Data V1.1 (Download from LDC)
2. LDC2016E42: TAC KBP 2016 Bilingual Spanish-English Cold Start Pilot - Source Corpus (Download from LDC)
3. LDC2016E52: TAC KBP 2016 Bilingual Spanish-English Cold Start Pilot Assessment Results V1.1 (Download from LDC)
4. Cold Start 2013 Evaluation Corpus (for system development in conjunction with LDC2013E87 and LDC2013E101) (Download here)
5. TAC KBP 2016 Cold Start Slot Filling Evaluation Queries (Download here)
6. LDC2016E69: TAC KBP 2016 Cold Start Evaluation Queries and Manual Run (Download here)
7. TAC KBP 2016 Cold Start Evaluation Summary Statistics (Download here)


• Slot Filler Validation/Ensembling Track
1. TAC 2012 KBP Slot Filler Validation Evaluation Queries (for system development in conjunction with 2012 assessments in LDC2015E46) (Download Queries here and Team ID map here)
2. TAC 2013 KBP Slot Filler Validation Evaluation Queries V1.2 (for system development in conjunction with 2013 assessments in LDC2015E46) (Download Queries here and Team ID map here)
3. TAC 2014 KBP Slot Filler Validation Evaluation Queries V1.1 (for system development in conjunction with 2014 assessments in LDC2015E46) (Download Queries here and Team ID map here)
4. TAC 2015 KBP Slot Filler Validation Evaluation Input V1.1 (for system development in conjunction with 2015 assessments in LDC2016E39) (Download Input here and Team ID map here)
5. TAC 2016 KBP Slot Filler Validation Evaluation Input (Download Input here)


• Event Track
1. LDC2016E49: TAC KBP 2016 English Event Argument Linking Pilot Source Corpus (Download from LDC)
2. LDC2016E51: TAC KBP 2016 English Event Argument Linking Pilot Queries and Manual Run (Download from LDC)
3. LDC2016E59: TAC KBP 2016 English Event Argument Linking Pilot Assessment Results (Download from LDC)
4. LDC2016E60: TAC KBP 2016 English Event Argument Linking Pilot Gold Standard (Download from LDC)
5. LDC2016E67: TAC KBP English Event Nugget Training Data - Character Based Format Conversion (Download from LDC)
6. LDC2016E72: TAC KBP 2016 Eval Core Set Event Nugget Annotation (Download here)
7. LDC2016E73: TAC KBP 2016 Eval Core Set Rich ERE Annotation with Augmented Event Argument v2 (Download here)


• Belief and Sentiment Track
1. LDC2014E55: DEFT Committed Belief Annotation R1 V1.1 (Download from LDC)
2. LDC2014E106: DEFT Committed Belief Annotation R2 (Download from LDC)
3. LDC2015E99: DEFT Chinese Committed Belief Annotation (Download from LDC)
4. LDC2016E40: DEFT Spanish Committed Belief Annotation (Download from LDC)
5. LDC2016E27: DEFT English Belief and Sentiment Annotation V2 (Download from LDC)
6. LDC2016E61: DEFT Chinese Belief and Sentiment Annotation (Download from LDC)
7. LDC2016E62: DEFT Spanish Belief and Sentiment Annotation (Download from LDC)
8. LDC2016E71: TAC KBP 2016 Eval Core Set Rich ERE Annotation (Download here)