TAC SM-KBP 2022 Data

Data that are required for the TAC 2022 tracks are distributed at no cost to track participants. Whenever possible, data are distributed by NIST or the Linguistic Data Consortium via Web download; data are mailed as physical disks only if they cannot be made available for download.

Access to TAC 2022 data is restricted to registered TAC 2022 participants who have submitted all the required User Agreement forms. Each participating team will provide a TAC 2022 Team ID and will receive a Team Password upon registration. Teams that have participated in past TAC evaluations must register and obtain a new TAC 2022 Team ID and password for 2022. Teams must also submit new (current) User Agreement forms for 2022. Once the required User Agreement forms have been received for that team, NIST will activate the TAC 2022 Team ID and Password to give access to password-protected TAC 2022 resources that are distributed by NIST (a different username and password are required for data that are downloaded from LDC's intranet).

Data resources from past KBP and related evaluations listed in the 2022 Text Analysis Conference (TAC) Evaluation License Agreement are available for system development and must be requested by name and catalog number from the LDC upon registration; teams are responsible for requesting the past data that are relevant for their respective tracks when submitting the Evaluation License Agreement to the LDC.

In addition to resources listed in the 2022 Text Analysis Conference (TAC) Evaluation License Agreement, the following KBP 2022 development data and evaluation data are available to KBP 2022 teams:

• SM-KBP Track
1. LDC2021E11: AIDA Phase 3 Practice Topic Source Data V2.0 (Download from LDC)
2. LDC2021E15: AIDA Phase 3 TA1 Practice Topic Annotation V6.0 (Download from LDC)
3. LDC2021E16: AIDA Phase 3 TA3 Practice Topic Annotation V5.0 (Download from LDC)
4. LDC2022R02: AIDA Phase3 Evaluation Source Data V1.0 (Download from LDC)
5. DWD snapshots of Wikidata:
• wikidata-20210215-dwd-v2: https://drive.google.com/drive/folders/1OIZegxxrs_Hv2ZhDsSO-zLVARCR60P01?usp=sharing (DWD V2 is the version on which the KGTK similarity service is built, used by the automatic scorer for Task 1)
• wikidata-20220623-dwd-v6: https://drive.google.com/drive/folders/1a6cUI1UEWRTNbvqtLAfJU0wEJ4ssTqdz?usp=sharing
6. DWD overlay (defining event types and relation types, along with their argument roles and selectional preferences):
• xpo_v5.1a.json (released July 20, 2022, based on Qnodes and Pnodes in the live Wikidata; most similar DWD version would be DWD V6)


7. TA1_Practice_score_summaries.tgz
8. TA1_Evaluation_score_summaries.tgz