LINGUIST List 13.1426

Tue May 21 2002

Confs: Natural Lang Processing/Parsing Systems

Editor for this issue: Marie Klopfenstein <marielinguistlist.org>

Directory

1. John Carroll, LREC2002: Beyond PARSEVAL Workshop -- Call for Participation

 Call for Participation

 Beyond PARSEVAL
 -- Towards Improved Evaluation Measures for Parsing Systems --

 http://let.dfki.uni-sb.de/BeyondPARSEVAL/

 LREC 2002 Workshop
 2nd June
 Las Palmas, Canary Islands, Spain

 Final Programme


9:15-9:30 Opening: Aims of the workshop

9:30-10:00 "Relational evaluation schemes"
 Ted Briscoe, John Carroll, Jonny Graham, Ann Copestake

10:00-10:30 "Towards a dependency-oriented evaluation for partial parsing"
 Sandra Kuebler, Heike Telljohann

10:30-11:00 "LinGO Redwoods -- a rich and dynamic treebank for HPSG"
 Stephan Oepen, Ezra Callahan, Dan Flickinger, Christoper D. Manning

Coffee break

11:30-12:30 Panel: Parser evaluation in context
 John Carroll, Patrick Paroubek, Owen Rambow, Hans Uszkoreit

Lunch break

14:00-14:30 "A test of the leaf-ancestor metric for parse accuracy"
 Geoffrey Sampson, Anna Babarczy

14:30-15:00 "Evaluating parser accuracy using edit distance"
 Brian Roark

Short break

15:10-15:40 "Evaluating syllabification: one category shared by many grammars"
 Karin Mueller

15:40-16:10 "Towards comparing parsers from different linguistic frameworks:
 an information theoretic approach"
 Gabriele Musillo, Khalil Sima'an

16:10-16:40 "Evaluation of the Gramotron parser for German"
 Franz Beil, Detlef Prescher, Helmut Schmid, Sabine Schulte im Walde

Coffee break

17:10-17:40 "Evaluating a wide-coverage CCG parser"
 Stephen Clark, Julia Hockenmaier

17:40-18:10 "A comparison of evaluation metrics for a broad coverage parser"
 Richard Crouch, Ronald M. Kaplan, Tracy H. King, Stefan Riezler

18:10-20:00 Wrap up and kick-off: Initiatives and action plans (open end)