TAC KBP 2017 Data

Data that are required for the TAC KBP 2017 tracks are distributed at no cost to track participants. Whenever possible, data are distributed by NIST or the Linguistic Data Consortium via Web download; data are mailed as physical disks only if they cannot be made available for download.

Access to TAC KBP 2017 data is restricted to registered TAC KBP 2017 participants who have submitted all the required User Agreement forms. Each participating team will provide a TAC 2017 Team ID and will receive a Team Password upon registration. Teams that have participated in past TAC evaluations must register and obtain a new TAC 2017 Team ID and password for 2017. Teams must also submit new (current) User Agreement forms for 2017. Once the required User Agreement forms have been received for that team, NIST will activate the TAC 2017 Team ID and Password to give access to password-protected KBP 2017 resources that are distributed by NIST (a different username and password are required for data that are downloaded from LDC's intranet).

Data resources from past KBP evaluations listed in the 2017 Text Analysis Conference (TAC) Knowledge Base Population Evaluation License Agreement are available for system development and must be requested by name and catalog number from the LDC upon registration; teams are responsible for requesting the past KBP data that are relevant for their respective tracks when submitting the Evaluation License Agreement to the LDC.

In addition to KBP resources listed in the 2017 Text Analysis Conference (TAC) Knowledge Base Population Evaluation License Agreement, the following KBP 2017 development data and evaluation data are available to KBP 2017 teams:

• Non-TAC KBP Resources (for system development)
1. LDC2017E24: DEFT ERE Cross-Doc Event Coreference Training Data Annotation V2 (request from the LDC)


• Multiple KBP Tracks (Source Corpora)
1. LDC2017E25: TAC KBP 2017 Evaluation Source Corpus V1.1 (Download README here and Corpus here) (July 6, 2017)
2. LDC2017E51: TAC KBP 2017 Evaluation Core Source Corpus (Download README here and Corpus here) (September 25, 2017)


• Cold Start SF/KB Track
1. TAC KBP 2017 Cold Start Slot Filling Evaluation Queries (Download Queries here) (July 12, 2017)
2. TAC KBP 2017 Cold Start "Manual Run" Evaluation Results (Download here) (Revised November 2, 2017)
3. LDC2017E56: TAC KBP 2017 Cold Start Evaluation Assessment Results V3.0 (Download here) (December 18, 2017)


• Entity Discovery and Linking Track
1. TAC KBP 2017 10-Language EDL Pilot Evaluation Source Corpus V2 (Download here) (Revised October 19, 2017)
2. TAC KBP 2017 TEDL Evaluation Summary Statistics V1.1 (Download here) (October 13, 2017)
3. LDC2017E52: TAC KBP 2017 Entity Discovery and Linking Evaluation Gold Standard Entity Mentions and Knowledge Base Links (Download here) (October 18, 2017)


• Event Track
1. LDC2017E79: TAC KBP 2017 Event Sequencing Eval Source Data (Download here) (October 3, 2017)
2. TAC KBP 2017 Event Nugget Evaluation Summary Statistics (Download here) (October 13, 2017)
3. TAC KBP 2017 Event Argument Evaluation Summary Statistics (Download here) (October 18, 2017)
4. LDC2017E54: TAC KBP Eval Core Set Event Nugget Annotation (Download here) (October 18, 2017)
5. LDC2017E55: TAC KBP 2017 Eval Core Set Rich ERE Annotation with Augmented Event Arguments (Download here) (October 18, 2017)
6. LDC2017E83: TAC KBP 2017 Event Sequencing Eval After Link Parent Child Annotation (Download here) (November 1, 2017)


• Belief and Sentiment Track
1. LDC2017E53: TAC KBP 2017 Eval Core Set Rich ERE Annotation (Downoad here) (October 3, 2017)
2. TAC KBP 2017 Eval BeSt Predicted ERE V2 (Download here) (October 3, 2017)
3. LDC2017E80: TAC KBP 2017 Belief and Sentiment Evaluation Gold Standard Annotation (Download here) (November 1, 2017)