Go to the NIST home page Go to the TAC Home Page TAC Banner

Return to TAC Homepage

TAC 2016 Tracks
TAC 2016 Workshop




TAC 2016 papers, posters/demos, and presentations

Each team that submits runs for evaluation is required to write a paper for the TAC 2016 proceedings that reports how the runs were produced (to the extent that intellectual property concerns allow) and any additional experiments or analysis conducted using TAC 2016 data. A draft version of the proceedings papers is distributed to TAC 2016 workshop attendees. The final proceedings are published on the TAC web site only after the workshop. The workshop version of papers gives workshop attendees something concrete to discuss during the meeting itself, but participants have the opportunity to revise their papers based on findings from workshop discussion before publication in the final proceedings.

All teams are strongly encouraged to present their system(s) and results as a poster/demo at the TAC 2016 workshop. Teams may also give oral presentations at the workshop; oral presentations are selected based on presentation proposals rather than on entire papers.

Unless specifically invited by the TAC Advisory Committee, a team may contribute a paper to the proceedings and give a presentation at the TAC 2016 workshop only if it has also submitted at least one run for evaluation.

Papers

By October 10, 2016 each team should submit a short description of their 2016 system(s), which will be used for the track coordinators' overview paper. Please email the short system description for each track directly to the track coordinator. The description should be no more than 1 page and should contain: a short system overview, description of training data used, description of the machine learning model (if any), and any results on development data.

Each team is required to write a full paper that will be distributed at the workshop and published in the final proceedings. The paper should consist of a description of the team's TAC 2016 system(s) and any additional experiments or analysis of TAC 2016 tasks, evaluations, and results. Papers do not undergo a standard peer review, although NIST reserves the right to exclude non-responsive papers. (Participants are encouraged to expand on the work reported in their TAC proceedings papers and submit the results to peer-reviewed conferences, journals, and other venues.)

Each team should write a single paper for all tracks in which the team participated. Paper length is limited to 12 pages for the first track, plus 4 additional pages per additional track (e.g., a team that submits runs for three tracks would be allowed a total of 20 pages). NIST reserves the right to exclude papers that exceed the page limit.

Papers must print on 8.5 x 11 inch paper. These are the only paper formatting requirements:

  • standard US-letter size (not A4)
  • minimum 10pt type
  • minimum 2 cm bottom margin
  • maximum 12 pages for the first task, plus 4 additional pages for each additional task
  • authors' names and affiliations should appear on the paper
  • single .pdf file only (no Word documents)
It is recommended that you use the ACL-HLT 2011 style files, which meet the above requirements.

The workshop version of the paper and signed copyright release form(s) should be submitted to NIST by November 1, 2016. The paper should be submitted using the online paper submission form. The copyright release form(s) should be sent by email or fax when the paper is submitted.

The final (proceedings) version of the paper should be submitted to NIST by March 15, 2017, using the online proceedings paper submission form:

Posters/Demos

Each team is strongly encouraged to present a poster and/or demo at the TAC 2016 workshop. Posters should be no more than 4 feet wide and 5 feet tall. Pins are provided to attach the poster to a padded wall in a hallway (so it is better to not back the poster with anything like foamcore). For demos, NIST will provide tables, outlets, and wireless Internet access to the NIST Visitor's network, to which participants can connect their own laptop.

Requests to give a poster and/or demo may be sent to tac-manager@nist.gov (please include the team name in all correspondences).

Oral Presentations

Teams wishing to give an oral presentation at the workshop must submit a presentation proposal. Each team may submit one proposal for each task in which it participated:

  1. Entity Discovery (and Linking)
  2. KB Construction
  3. Slot Filling
  4. Slot Filler Validation/Ensembling
  5. Event Nuggets
  6. Event Arguments
  7. Belief and Sentiment

A presentation proposal should consist of a short abstract about the team's experiments in that track. The abstract should provide a description of the system, but should also emphasize what experiments were done and why they are interesting or unusual. Each abstract should be no more than 1000 words. Abstracts should be emailed as separate attachments to tac-manager@nist.gov. Please rank the proposals by the team's desire to present each proposed talk and include the following at the beginning of each proposal:

  • Team ID
  • Track
  • Task
  • Title of presentation
  • Name and affiliation of person(s) giving the presentation
  • Preferred talk length: Full (~30 minutes) or Short (~15 minutes)
  • Is the presentation contingent on the presenter's ability to secure travel requirements such as visa, funding, etc.? (NIST is unable to expedite visa applications or provide funding for travel.)

Presentation proposals will be selected at NIST based on the intrinsic value of each proposal, the needs of the program, and the desirability ranking provided by the team.

The deadline for submitting oral presentation proposals is October 18. Teams are notified by October 20 whether a proposal has been accepted for presentation.

Copyright release

Any organization whose paper will appear in the TAC proceedings must sign a copyright release form. Teams that are giving an oral presentation must also fill in the speaker section of the form. The senior author at each organization can sign for other authors, but if a team consists of multiple organizations, a signed copyright release form is required from each organization.

To submit copyright forms: Print out the copyright form, fill it in, sign it, and send the signed form to NIST as a fax or emailed pdf attachment. In your email message or fax cover letter, please provide your TAC 2016 team name, email address, and subject "TAC 2016 copyright release for YourTeamName". Signed forms should be sent to:

    ATTN: Angela Ellis
    Fax #: +1 301-975-5287
    Email: angela.ellis@nist.gov


NIST is an agency of the
U.S. Department of Commerce

privacy policy / security notice / accessibility statement
disclaimer
FOIA

Last updated: Tuesday, 28-Mar-2017 11:20:23 EDT
Comments to: tac-web@nist.gov