Go to the NIST home page Go to the TAC Home Page TAC Banner

Return to TAC Homepage

TAC 2018 Tracks
  SM-KBP
  EDL
  SRIE
  DDI
Call for Participation
Track Registration
Reporting Guidelines
TAC 2018 Workshop




Call for Participation

Text Analysis Conference (TAC 2018)

https://tac.nist.gov/2018/

Track Evaluations: February - October 2018
Workshop: November 13-14, 2018

Conducted by:
U.S. National Institute of Standards and Technology (NIST)


With support from:
U.S. Department of Defense (DOD)
U.S. National Institutes Health (NIH)

INTRODUCTION

The Text Analysis Conference (TAC) is a series of shared tasks, evaluations and workshops organized to promote research in Natural Language Processing and related applications, by providing a large test collection, common evaluation procedures, and a forum for organizations to share their results. TAC comprises multiple tracks, each of which focuses on a particular subproblem of NLP. TAC tracks aim to improve end-user tasks, but also include diagnostic and component evaluations situated within the context of end-user tasks.

You are invited to participate in TAC 2018. Organizations may choose to participate in any or all of the TAC tracks. NIST will provide test data for each track, and track participants will run their NLP systems on the data and return their results to NIST for evaluation. The annual conference culminates in a November workshop at NIST in Gaithersburg, Maryland, USA.

All results submitted to NIST are archived on the TAC web site, and all evaluations of submitted results are included in the conference proceedings. Dissemination of TAC work and results other than in the conference proceedings is welcomed, but the conditions of participation specifically preclude any advertising claims based on TAC results.

TRACKS

TAC 2018 has four tracks:

TRACK REGISTRATION

Organizations wishing to participate in any of the TAC 2018 tracks are invited to register online by July 15, 2018 at:

Participants are advised to register and submit all required agreement forms as soon as possible in order to receive timely access to track resources, including any sample and training data. Participants should also make sure they are subscribed to the mailing lists for the tracks for which they are registered. Registration for a track does not commit you to participating in the track, but is helpful to know for planning. Late registration will be permitted only if resources allow.

Any questions about conference participation may be sent to the TAC project manager: tac-manager@nist.gov.

WORKSHOP

The TAC 2018 workshop will be held November 13-14, 2018, in Gaithersburg, Maryland, USA. The TAC workshop is a forum both for presentation of results (including failure analyses and system comparisons), and for more lengthy system presentations describing techniques used, experiments run on the data, and other issues of interest to researchers in NLP.

SCHEDULE

    TAC 2018 Schedule
    July 15Deadline for registration for track participation
    August - OctoberTrack evaluation windows (varies by track)
    By mid OctoberRelease of individual evaluated results to participants (most tracks)
    October 15Deadline for short system descriptions
    October 15Deadline for workshop presentation proposals
    October 20Notification of acceptance of presentation proposals
    November 1Deadline for system reports (workshop notebook version)
    November 13-14TAC 2018 workshop in Gaithersburg, Maryland, USA
    February 15, 2019Deadline for system reports (final proceedings version)

NIST is an agency of the
U.S. Department of Commerce

privacy policy / security notice / accessibility statement
disclaimer
FOIA

Last updated: Monday, 14-May-2018 14:20:43 EDT
Comments to: tac-web@nist.gov