TAC KBP 2014 Data

Data that are required for the TAC KBP 2014 tracks are distributed at no cost to track participants. Whenever possible, data are distributed by NIST or the Linguistic Data Consortium via Web download; data are mailed as physical disks only if they cannot be made available for download.

Access to TAC KBP 2014 data is restricted to registered TAC KBP 2014 participants who have submitted all the required User Agreement forms. Each participating team will provide a TAC KBP 2014 Team ID and will receive a Team Password upon registration. Teams that have participated in past TAC evaluations must register and obtain a new TAC KBP 2014 Team ID and password for 2014. Teams must also submit new (current) User Agreement forms for 2014. Once the required User Agreement forms have been received for that team, NIST will activate the TAC KBP 2014 Team ID and Password to give access to password-protected KBP 2014 resources that are distributed by NIST (a different username and password are required for data that are downloaded from LDC's intranet).

Data resources from past KBP evaluations listed in the 2014 Text Analysis Conference (TAC) Knowledge Base Population Evaluation License Agreement are available for system development and must be requested by name and catalog number from the LDC upon registration; some of these data resources (specifically, the reference KB) will also be reused in some tracks in the KBP 2014 evaluation, and teams are responsible for requesting the past KBP data that are relevant for their respective tracks when submitting the Evaluation License Agreement to the LDC. When additional KBP 2014 data become available for each track, they will automatically be distributed to KBP 2014 teams registered for that track.

In addition to KBP resources listed in the 2014 Text Analysis Conference (TAC) Knowledge Base Population Evaluation License Agreement, the following KBP 2014 evaluation data have been distributed to KBP 2014 teams that are registered for each track:

• All KBP Tracks
• LDC2014E13: TAC 2014 KBP English Source Corpus (Shipped as 6 DVDs from LDC) (May 2, 2014)


• English Entity Discovery and Linking Track
• TAC 2014 KBP English Entity Discovery and Linking Evaluation Results (Download here) (March 1, 2015)
• LDC2014E81: TAC 2014 KBP English Entity Discovery and Linking Evaluation Queries and Knowledge Base Links V2.0 (Download here) (February 13, 2015)
• LDC2014E81: TAC 2014 KBP English Entity Discovery and Linking Evaluation Queries and Knowledge Base Links V1.1 (Download here) (September 24, 2014)
• LDC2014R51: TAC 2014 KBP English Entity Discovery and Linking Evaluation Queries V1.1 (Download here) (September 30, 2014)
• LDC2014E87: TAC 2014 KBP English Entity Discovery and Linking Evaluation Source Corpus (Download here) (September 22, 2014)
• LDC2014E54: TAC 2014 KBP English Entity Discovery and Linking Training Data V1.3 (Download from LDC) (September 30, 2014)
• LDC2014E15: TAC 2014 KBP English Entity Linking Training AMR Queries and Knowledge Base Links V1.1 (Download from LDC) (July 22, 2014)


• Chinese Entity Linking Track
• LDC2014E83: TAC 2014 KBP Chinese Entity Linking Evaluation Queries and Knowledge Base Links V2.0 (Download here) (February 13, 2015)
• LDC2014R52: TAC 2014 KBP Chinese Entity Linking Evaluation Queries V2.0 (Download here) (September 15, 2014)
• LDC2014E47: TAC 2014 KBP Chinese Entity Linking Discussion Forum Training Data (Download from LDC) (July 3, 2014)
• LDC2014E29: TAC 2014 KBP Chinese Source Corpus (Shipped as 6 DVDs from LDC) (June 3, 2014)


• Spanish Entity Linking Track
• TAC 2014 KBP Entity Linking Evaluation Summary Statistics (Download here) (October 21, 2014)
• LDC2014E84: TAC 2014 KBP Spanish Entity Linking Evaluation Queries and Knowledge Base Links (Download here) (October 6, 2014)
• LDC2014R53: TAC 2014 KBP Spanish Entity Linking Evaluation Queries (Download here) (September 15, 2014)
• LDC2014E46: TAC 2014 KBP Spanish Entity Linking Discussion Forum Training Data V1.1 (Download from LDC) (September 30, 2014)
• LDC2014E30: TAC 2014 KBP Spanish Source Corpus (Shipped as 1 DVD from LDC) (May 2, 2014)


• English Slot Filling Track
• TAC 2014 KBP English Regular Slot Filling Evaluation Summary Statistics (Download here) (Revised October 21, 2014)
• LDC2014E75: TAC 2014 KBP English Regular Slot Filling Evaluation Assessment Results V2.0 (Download here) (October 6, 2014)
• LDC2014E66: TAC 2014 KBP English Regular Slot Filling Evaluation Queries and Annotations V1.1 (Download here) (October 6, 2014)
• LDC2014R38: TAC 2014 KBP English Regular Slot Filling Evaluation Queries (Download here) (July 21, 2014)


• Slot Filler Validation Track
• TAC 2014 KBP Slot Filler Validation Evaluation Queries V1.1 (Download here) (September 16, 2014)
• TAC 2013 KBP Slot Filler Validation Evaluation Queries V1.2 (for system development in conjunction with LDC2013E45) (Download here) (August 1, 2014)


• Cold Start Track
• KBP 2014 Cold Start Evaluation Results (Download here) (Revised July 17, 2015)
• LDC2014E82: TAC 2014 KBP English Cold Start Evaluation Assessment Results V2.1 (Download here) (Revised May 14, 2015)
• LDC2014E73: TAC 2014 KBP English Cold Start Evaluation Queries and Annotations V1.1 (Download here) (September 23, 2014)
• LDC2014R42: TAC 2014 KBP English Cold Start Evaluation Source Corpus (Download here) (August 4, 2014)


• Sentiment Track
• TAC 2014 KBP English Sentiment Slot Filling Evaluation Summary Statistics (Download here) (October 22, 2014)
• LDC2014E85: TAC 2014 KBP English Sentimet Slot Filling Evaluation Assessment Results (Download here) (October 6, 2014)
• LDC2014E72: TAC 2014 KBP English Sentiment Slot Filling Evaluation Queries and Annotations V1.1 (Download here) (September 23, 2014)
• LDC2014R39: TAC 2014 KBP English Sentiment Slot Filling Evaluation Queries V1.1 (Download here) (July 28, 2014)


• Event Track
• KBP 2014 Event Argument Extraction Evaluation Results (Download here) (December 18, 2014)
• LDC2014E88: TAC 2014 KBP English Event Argument Extraction Evaluation Assessment Results V2.0 (Download here) (February 13, 2015)
• LDC2014R43: TAC 2014 KBP English Event Argument Extraction Evaluation Source Corpus V1.1 (Download here) (August 11, 2014)
• LDC2014E40: TAC 2014 KBP Event Argument Extraction Pilot Assessment Results V1.1 (Download from LDC) (May 30, 2014)
• LDC2014E20: TAC 2014 KBP Event Argument Extraction Pilot Source Corpus V1.1 (Download from LDC) (April 1, 2014)