TAC KBP 2017 Event Argument Tasks

Overview

The Event Argument and Linking (EAL) tasks of the TAC KBP Event track focus on extracting event arguments and linking arguments that belong to the same event. EAL will be offered in three languages: English, Spanish, and Chinese. As in 2015-2016, all tasks will operate using the Rich ERE definitions of events, nuggets, event hopper coreference, and argument validity. As in 2014-2016, the argument task will continue to support some inference of arguments that were ignored through "trumping" in Rich ERE. The evaluations will use the EAL event taxonomy from 2016.

As in EAL 2016, the EAL 2017 document level tasks will all be scored via alignment with an LDC gold standard conforming to RichERE guidelines. There is no cross-lingual/cross-document event frame task in EAL 2017; teams wishing to be evaluated on cross-lingual/cross-document event frames should consider participating in the Cold Start KB track.

References

• ACE 2005 Training Data: http://catalog.ldc.upenn.edu/LDC2006T06

While the ACE 2005 event annotation is being provided to all participants, this task diverges from ACE in some cases. One example of divergence is the addition of correct answers derived through inference/world knowledge. This evaluation will treat as correct some cases that were explicitly excluded in ACE 2005.

Task Coordinator