Go to the NIST home page Go to the TAC Home Page TAC Banner

Return to TAC Homepage

TAC 2020 Tracks
  EPIC-QA
  RUFES
  SM-KBP
Call for Participation
Track Registration
Reporting Guidelines
TAC 2020 Workshop




Thirteenth Text Analysis Conference (TAC 2020)

Evaluation: August 2020 - January 2021
Workshop: February 22-23, 2021

Conducted by:
U.S. National Institute of Standards and Technology (NIST)

With support from:
U.S. Department of Defense (DOD)

The Text Analysis Conference (TAC) is a series of evaluation workshops organized to encourage research in Natural Language Processing and related applications, by providing a large test collection, common evaluation procedures, and a forum for organizations to share their results. TAC comprises sets of tasks known as "tracks," each of which focuses on a particular subproblem of NLP. TAC tracks focus on end-user tasks, but also include component evaluations situated within the context of end-user tasks.

The Thirteenth Text Analysis Conference (TAC 2020) has three tracks:

  • Epidemic Question Answering (EPIC-QA)
    The goal of the EPIC-QA track is to evaluate systems on their ability to provide timely and well-supported answers to questions about the disease COVID-19, its causal virus SARS-CoV-2, related coronaviruses, and the recommended response to the pandemic. Because questions arise from both experts and non-experts in the field, EPIC-QA systems are challenged to return expert-level answers as expected by the scientific and medical communities as well as answers in consumer-friendly language for the general public.
    Track coordinators: Dina Demner-Fushman (ddemner@mail.nih.gov) and Travis Goodwin (travis.goodwin@nih.gov)
    Home page: https://bionlp.nlm.nih.gov/epic_qa/
    Group / mailing list: epic-qa@list.nist.gov

  • Recognizing Ultra Fine-grained EntitieS (RUFES)
    The goal of the KBP RUFES track is to extract and corefer mentions of fine-grained entity types in text.
    Track coordinator: Heng Ji (hengji@illinois.edu) and Avirup Sil (avi@ibm.com)
    Home page: https://tac.nist.gov/2020/KBP/RUFES/
    Group / mailing list: tac-kbp@list.nist.gov

  • Streaming Multimedia Knowledge Base Population (SM-KBP)
    The goal of the SM-KBP track is to develop and evaluate technologies that extract structured Knowledge Elements (KEs) from a variety of unstructured sources in order to generate explicit alternative interpretations of events, situations, and trends in noisy, conflicting, and potentially deceptive information environments.
    Track coordinator Hoa Dang (hoa.dang@nist.gov)
    Home page: https://tac.nist.gov/2020/KBP/SM-KBP/
    Group/ mailing list: sm-kbp@list.nist.gov

    TAC 2020 Schedule
    August 2020 - January 2021Track evaluation windows (varies by track)
    January 15, 2021Deadline for registration for track participation
    January 2021Release of individual evaluated results to participants (most tracks)
    February 3, 2021Deadline for short system descriptions
    February 3, 2021Deadline for workshop presentation proposals
    February 8, 2021Notification of acceptance of presentation proposals
    February 14, 2021Deadline for system reports (workshop notebook version)
    February 22-23, 2021Thirteenth TAC workshop (online)
    April 1, 2021Deadline for system reports (final proceedings version)


BACK to General Information about Tracks

NIST is an agency of the
U.S. Department of Commerce

privacy policy / security notice / accessibility statement
disclaimer
FOIA

Last updated: Wednesday, 10-Mar-2021 08:10:57 MST
Comments to: tac-web@nist.gov