TAC KBP 2018 Data

Data that are required for the TAC 2018 tracks are distributed at no cost to track participants. Whenever possible, data are distributed by NIST or the Linguistic Data Consortium via Web download; data are mailed as physical disks only if they cannot be made available for download.

Access to TAC 2018 data is restricted to registered TAC 2018 participants who have submitted all the required User Agreement forms. Each participating team will provide a TAC 2018 Team ID and will receive a Team Password upon registration. Teams that have participated in past TAC evaluations must register and obtain a new TAC 2018 Team ID and password for 2018. Teams must also submit new (current) User Agreement forms for 2018. Once the required User Agreement forms have been received for that team, NIST will activate the TAC 2018 Team ID and Password to give access to password-protected TAC 2018 resources that are distributed by NIST (a different username and password are required for data that are downloaded from LDC's intranet).

Data resources from past KBP and related evaluations listed in the 2018 Text Analysis Conference (TAC) Evaluation License Agreement are available for system development and must be requested by name and catalog number from the LDC upon registration; teams are responsible for requesting the past data that are relevant for their respective tracks when submitting the Evaluation License Agreement to the LDC.

In addition to resources listed in the 2018 Text Analysis Conference (TAC) Evaluation License Agreement, the following KBP 2018 development data and evaluation data are available to KBP 2018 teams:

• SM-KBP Track
1. LDC2018E01: AIDA Seedling Corpus V2.0 (Download from LDC)
2. LDC2018E45: AIDA Scenario 1 Seedling Annotation V6.0 (Download from LDC)
• AIDA Scenario 1 Seedling Annotation AIF
3. LDC2018E52: AIDA Scenario 1 Seedling Corpus Part 2 V2.0 (Download from LDC)
4. LDC2018E53: AIDA Scenario 1 Seedling Background Corpus Non Eval V1.0 (Download from LDC)
5. LDC2018E63: AIDA Scenario 1 Seedling Corpus Training Data Video Segmentation V1.0 (Download from LDC)
6. LDC2018E64: AIDA Scenario 1 Seedling Background Corpus Non-Eval Video Segmentation V1.0 (Download from LDC)
• README (supersedes the README file in the LDC2018E64 package)
7. LDC2018E62: AIDA Month 9 Pilot Eval Corpus V1.0 (Shipped as physical disk to SM-KBP teams holding a 2018 TAC Evaluation License)
• LDC2018E62.parent_children.ttl (AIF representation of parent-child mapping in docs/parent_children.tab file)
• LDC2018E62.parent_children.tsv (.tsv representation of parent-child mapping in docs/parent_children.tab file)
8. SM-KBP 2018 Evaluation Queries (supersedes AIDA 2018 Task1 Evaluation Queries Batch1)
• SM-KBP 2018 Evaluation Queries Docker
9. AIDA 2018 Task1b Feedback Hypotheses V2
10. SM-KBP 2018 Task3 Information Need V2
11. LDC2018E62.coredocs.txt (Core documents for evaluation of class-level and zero-hop queries)