TAC 2008 Recognizing Textual Entailment (RTE) Track

• Track coordinators:
  
Danilo Giampiccolo, CELCT (Trento), Italy ([email protected])
Hoa Trang Dang, NIST, USA ([email protected])

• RTE-4 Call for Participation
• RTE-4 Task Guidelines
• Past RTE Data  (Updated April 28, 2008)
• RTE Resource Pool
• RTE-4 Test Set (Available as Past TAC Data)
• RTE-4 Annotated Test Set (Available as Past TAC Data)

The goal of the RTE Track is to develop systems that recognize when one piece of text entails another. The TAC 2008 RTE track at TAC (RTE-4) is co-sponsored by PASCAL-2 and continues the efforts of past PASCAL RTE Challenges. RTE-4 includes the 3-way classification task that was piloted in RTE-3. The goal of making a three-way decision of "ENTAILMENT", "CONTRADICTION" and "UNKNOWN" is to drive systems to make more precise informational distinctions; a hypothesis being unknown on the basis of a text should be distinguished from a hypothesis being shown false/contradicted by a text. Participants are invited to use Past RTE Data for development.

Schedule

Mailing List

The mailing list for the RTE Track is [email protected]. The list is used to discuss and define the task guidelines for the track, as well as for general discussion related to textual entailment and its evaluation. To subscribe, send a message to [email protected] such that the body consists of the line:
            subscribe rte <FirstName> <LastName>
In order for your messages to get posted to the list, you must send them from the email address used when you subscribed to the list. For additional information on how to use mailing lists hosted at NIST, send a message to [email protected] such that the body consists of the line:
            HELP

Organizing Committee

Ido Dagan, Bar Ilan University, Israel
Hoa Trang Dang, NIST, USA
Bill Dolan, Microsoft Research, USA
Danilo Giampiccolo, CELCT (Trento), Italy
Bernardo Magnini, ITC-irst (Trento), Italy

BACK to All TAC 2008 Tracks