LINGUIST List 13.1199

Tue Apr 30 2002

Confs: Lang Resources and Evaluation

Editor for this issue: Marie Klopfenstein <>

Please keep conferences announcement as short as you can; LINGUIST will not post conference announcements which in our opinion are excessively long.


  1. Steven Krauwer, Roadmap Workshop at LREC2002

Message 1: Roadmap Workshop at LREC2002

Date: Thu, 25 Apr 2002 15:18:12 +0200 (MEST)
From: Steven Krauwer <>
Subject: Roadmap Workshop at LREC2002


 Towards a Roadmap for Multimodal Language Resources and Evaluation

 An ELSNET workshop at LREC 2002

 Las Palmas, Canary Islands, Spain

 Sunday, June 2 2002 (14:30 - 20:00)

 Aim of the workshop:

The aim of the proposed workshop is to bring together key players
in the field of resources and evaluation in order to make a first
step towards the creation of a broadly supported Roadmap for
Language Resources, i.e. a broadly supported view on the longer,
medium and shorter term needs and priorities. This activity
should be seen in the context of ELSNET's other roadmapping
activities (see, which aim at
developing a technological roadmap for the whole field of Human
Language Technologies.

The purpose of such roadmaps is to give the R&D community an
instrument to identify opportunities for concertation of their
activities and better exploitation of possible synergies between
players all over the world.

 Scope of this workshop:

As there is no standard model for roadmaps for resources and
evaluation available, we will narrow the scope of this
roadmapping workshop to a specific sub-area: Multimodal Language
Resources and Evaluation. This will make our discussions more
focused and concrete, and it will also allow us to exploit the
fact that this workshop will take place the day after the
workshop dedicated to Multimodal Resources and Evaluation of
Multimodal Systems (MREMS) in general.

 Provisional program:

Start End Action Title & Actor(s)
14:30 14:45 Opening Introduction to this workshop 
 (Steven Krauwer)
14:45 15:15 Talk Summary of the MREMS Workshop 
 (Mark Maybury) 
15:15 15:40 Talk Challenges and Important Aspects in 
 Planning and Performing Evaluation 
 Studies for Multimodal Dialogue Systems 
 (Susanne H´┐Żllerer)
15:40 16:05 Talk XML and multimodal corpus design: 
 experiences with multi-layered stand-off 
 annotations in the GeM corpus 
 (John Bateman, Judy Delin, 
 Renate Herschel)
16:05 16:30 Talk Towards a roadmap for Human Language 
 Technologies: Dutch-Flemish experience 
 (Diana Binnenpoorte, Catia 
 Cucchiarini, Elisabeth D'Halleweyn, 
 Janienke Sturm and Folkert de Vriend)
16:30 17:00 Break
17:00 17:30 Talk Introduction to the plenary exercises
 (Steven Krauwer)
17:30 18:30 Exercise Identifying priorities (All)
18:30 19:30 Exercise Putting them on a timeline (All)
19:30 20:00 Discussion Where to go from here 
 (All & Steven Krauwer)
 20:00 Closing

 Recommended reading (preferably before the workshop):

 * ELSNET's First Roadmap Report
 (, edited
 by Ole Bernsen
 * ELSNET's Second Roadmap Report
 (, edited
 by Dorothee and Andreas Eisele)


 The registration fee for the workshop is 90 EURO for conference
 participants and 140 EURO for others. The fee includes two
 coffee breaks and the proceedings of the workshop.


 * Workshop:
 * Conference:

 Core Programme Committee:

 * Steven Krauwer (ELSNET / Utrecht University)
 * Hans Uszkoreit (DFKI Saarbruecken)
 * Antonio Zampolli (Univ of Pisa)
 * Joseph Mariani (LIMSI, Paris)
 * Ulrich Heid (IMS Stuttgart)
 * Khalid Choukri (ELDA Paris)
 * Mark Maybury (MITRE)

 Contact point:

Steven Krauwer, ELSNET coordinator,
UiL-OTS, Trans 10, 3512 JK Utrecht, NL
phone: +31 30 253 6050,
fax: +31 30 253 6000,
Steven Krauwer, ELSNET coordinator, UiL-OTS, Trans 10, 3512 JK Utrecht, NL
phone: +31 30 253 6050, fax: +31 30 253 6000, email:
Mail to author|Respond to list|Read more issues|LINGUIST home page|Top of issue