LINGUIST List 9.508

Wed Apr 1 1998

Calls: Lang.Resources & Evaluation,Labelled Deduction

Editor for this issue: Elaine Halleck <elainelinguistlist.org>

Directory

1. Steven Krauwer, Language Resources and Evaluation
2. ld98, Labelled Deduction

 PROVISIONAL PROGRAMME
 AND
 CALL FOR PARTICIPATION

 TOWARDS A EUROPEAN EVALUATION INFRASTRUCTURE
 FOR NL AND SPEECH.

 A workshop jointly organised by the European Network of
 Excellence in Language and Speech ELSNET and
 the EC Language Engineering-4 project ELSE

 to be held on Wednesday May 27, 9:00-13:00
 at the

 FIRST INTERNATIONAL CONFERENCE
 ON LANGUAGE RESOURCES AND EVALUATION

 GRANADA, SPAIN

Right now, a generic framework for semi-automatic quantitative
black-box evaluation of Speech and NLP systems does not exist in
Europe. When confronted to a choice, developers and users prefer
to ask the opinion of local experts as any other way of
processing is either unrealistic or too costly. The LE-4 project
ELSE aims at providing developers with a generic strategy and
definition of the primary building blocks needed to implement a
semi-automatic quantitative black-box evaluation scheme.

Prominent speakers from field the have been invited to present
papers addressing motivation, advantages, but also problems in
connection with the implementation of such an evaluation scheme
at an international scale.


Provisional programme:

09:00 Opening (Joseph Mariani, Steven Krauwer)

09:05 Confirmed Presentations:

 "The Darpa experience" (Charles Wayne)

 "Ethology and sociology of evaluation" (Lynette Hirschman)

 "The Aupelf experience" (Joseph Mariani)

 "Experience in Grace tagging evaluation" (Patrick Paroubek)

 "Experiences in bilingual text alignment evaluation and
 word sense disambiguation" (Jean Veronis)

 "Best practice and evaluation" (Ole Bernsen / Laila Dybkjaer)

 "Confidence measures and evaluation" (Lin Chase)

 "Evaluation within Eagles" (Maghi King)

 "Technology vs User-evaluation" (Marc Blasband)

 "Organising Parser Evaluation" (Richard Sutcliffe)

 "Evaluation for better products" (Christian Dugast)

 "Resources for evaluation" (Mark Liberman)

 "The ELSE project" (Patrick Paroubek)

12:00 Panel and discussion (Rob Gaizauskas, moderator)

13:00 Closing

The selected topics include the multilingual nature of
evaluation, lessons from the past (in Europe and the US), and the
need for language resources. At the workshop the first
intermediate results of the ELSE project will be presented and
discussed.

This call serves to invite interested parties to ACTIVE
participation in the workshop. During the workshop, ample
opportunity will be provided for the participants to react to the
presentation of the ELSE project, and to the talks by the invited
speakers. Furthermore participants will be given the opportunity
to give brief position statements.

The workshop is very timely as it takes place when the EC's 5th
Framework Programme is taking shape. It is clear that the
availability of a European evaluation infrastucture can be an
important factor in European R&D activities, and that it can only
be successful if it is organized and implemented on a European
scale.


PROGRAMME COMMITTEE

The workshop is coorganized by ELSNET and ELSE.
The Programme Committee will consist of the participants
in the ELSE LE-4 project:

Niels Ole Bernsen
Jean-Pierre Chanod
Khalid Choukri
Robert Gaizauskas
Steven Krauwer
Isabelle de Lamberterie
Joseph Mariani
Klaus Netter
Patrick Paroubek
Martin Rajman
Antonio Zampolli


CONTACT

Steven Krauwer
Trans 10, 3512 JK Utrecht, The Netherlands
Phone: +31 30 253 6050
Fax: +31 30 253 6000
Email: steven.krauwerlet.ruu.nl


REGISTRATION INFORMATION FOR LREC AND PRE AND POST CONFERENCE WORKSHOPS

Conference

The registration fees will be 25.000 pesetas (about 150 ECU) per
participant, with reduced fees of 20.000 pesetas (about 120 ECU)
for early registration by March 9, 1998, and 12.000 pesetas
(about 70 ECU) for students. The fees cover the following
services: a copy of the proceedings, a social dinner, coffee
breaks and refreshments. For accompanying persons, the social
dinner will be 6.000 pesetas (about 35 ECU).

Pre Conference Workshops

Pre Conference Workshops are 5,000 pesetas each for those
attending LREC and 10,000 pesetas each for those not attending
LREC, and include a copy of the proceedings of the workshop and a
coffee break.

Post Conference Workshop

The 2-day Post Conference Workshop is 10,000 pesetas for those
attending LREC and 20,000 pesetas for those not attending LREC,
and includes a copy of the proceedings of the workshop and coffee
breaks. Registration willbe made only for those persons who have
been invited to participate by the organizers.

Registration can be made on-site and must be paid in cash, using
pesetas.


FOR REGISTRATION FORMS AND MORE INFO: http://ceres.ugr.es/~rubio/elra.html

 	LD'98
 The First International Workshop on Labelled Deduction
 Freiburg, Germany, September 7 - 9, 1998

 http://www.informatik.uni-freiburg.de/~ld98

 *************************
 * FINAL CALL FOR PAPERS *
 *************************


 * Aim and format

 To survey research in the field, and to allow researchers (in Logic,
 Computer Science, Artificial Intelligence, Linguistics, etc.) to
 exchange ideas, techniques and results.
 o Both finished work and work in progress can be reported. We
 welcome three classes of submissions with presentation:
 + System description: 2 pages (system demo)
 + Work in progress: 5 pages (short presentation)
 + Polished work: 15 pages (long presentation)
 o Submissions will be refereed primarily on a basis of relevance,
 for an informal proceedings distributed only at the workshop.
 Since an intention of the workshop is to survey current work,
 versions of papers that have been, or may, appear elsewhere are
 welcome. Papers may later be submitted to a planned second round
 of refereeing, for proper publication as a book or journal special
 issue.
 o Submissions should be sent by email: please mail
 + a postscript file, and
 + a plain text file including title, authors, and contact
 information
 to ld98informatik.uni-freiburg.de

 * Topics of interest

 We welcome papers on current research in all aspects of Labelled
 Deduction, including but not limited to:
 o Logical modeling based on Labelled Deduction
 o Formal metatheory for, or based on, Labelled Deduction
 o Hybrid reasoners and combinations of logics based on labelling
 o Automated reasoning, implementation, and system support
 o Annotated logic programming
 o Applications

 * Important dates

 o Submission: April 15th, 1998
 o Notification: June 26th, 1998
 o Final Papers: July 31st, 1998
 o Workshop: Sept 7 - 9, 1998

 * Conference site

 Institut fuer Informatik of the University of Freiburg. Freiburg is a
 town of about 200,000 inhabitants at the edge of the Black-forest. The
 city is easily accessible, being within an hour from international
 airports in Strasbourg and Basel. There are also good connections
 (hourly trains) to airports in Frankfurt and Zurich, which are about 2
 to 3 hours away.

 * Organizing Committee

 David Basin and Luca Vigano`

 * Program Committee

 David Basin, Institut fuer Informatik, Freiburg, Germany
 Marcello D'Agostino, Universita` di Ferrara, Italy
 Dov Gabbay, Imperial College, London, UK
 Sean Matthews, Max-Planck-Institut fuer Informatik, Saarbruecken, 
	Germany
 Luca Vigano`, Institut fuer Informatik, Freiburg, Germany

 * Addresses

 o The LD'98 home page (http://www.informatik.uni-freiburg.de/~ld98/)
 o Email: ld98informatik.uni-freiburg.de
 o By post:

 LD'98
 c/o Luca Vigano`
 Institut fuer Informatik
 Universitaet Freiburg
 Am Flughafen 17
 79110 Freiburg
 Germany

 Phone: +49 (761) 203-8243
 Fax: +49 (761) 203-8242