Overview
Call for papers
Submission
Important dates
Workshop program
Workshop proceedings
Organizers
Program committee
Contact
NAACL-HLT 2012
Workshop on Evaluation Metrics and System Comparison
for Automatic Summarization
Workshop Program
June 8, 2012
| 9:00–9:30 |
An Assessment of the Accuracy of Automatic Evaluation in Summarization Karolina Owczarzak, John Conroy, Hoa Trang Dang and Ani Nenkova | |
| 9:30–10:00 |
Using the Omega Index for Evaluating Abstractive Community Detection Gabriel Murray, Giuseppe Carenini and Raymond Ng | |
| 10:00–10:30 |
Machine Translation for Multilingual Summary Content Evaluation Josef Steinberger and Marco Turchi | |
| 10:30–11:00 | BREAK | |
| 11:00–11:40 |
Pilot task proposal: Summarization of scientific literature (Invited Talk) Lucy Vanderwende and Anita de Waard | |
| 11:40–12:30 | Discussion and planning for the pilot | |
| 12:30–2:30 | LUNCH | |
| 2:30–3:30 |
Generation of Surveys of Research Areas (Invited Talk) Drago Radev | |
| 3:30–4:00 | BREAK | |
| 4:00–4:30 |
Ecological Validity and the Evaluation of Speech Summarization Quality Anthony McCallum, Cosmin Munteanu, Gerald Penn and Xiaodan Zhu | |
| 4:30–5:00 |
The Heterogeneity Principle in Evaluation Measures for Automatic Summarization Enrique Amigó, Julio Gonzalo and Felisa Verdejo | |
| 5:00–5:30 |
Discrepancy Between Automatic and Manual Evaluation of Summaries Shamima Mithun, Leila Kosseim and Prasad Perera | |