LINGUIST List 10.340

Thu Mar 4 1999

Confs: European Evaluation of Language Systems

Editor for this issue: Karen Milligan <>

Please keep conferences announcement as short as you can; LINGUIST will not post conference announcements which in our opinion are excessively long.


  1. Marc Blasband, European Evaluation of Language Systems

Message 1: European Evaluation of Language Systems

Date: Thu, 4 Mar 1999 09:09:34 +0100
From: Marc Blasband <>
Subject: European Evaluation of Language Systems


European Evaluation of Language Systems

Natural language systems open new perspectives for computer users and
therefore, user-friendliness gets a totally new dimension. Language is the
new frontier. Language Engineering (LE) offers a broad and easy contact
between users and computer applications.

However, user companies are used to purchasing more conventional software
systems. It is essential for these companies to know that LE requires
non-conventional evaluation methods and provides non-conventional benefits.

The Directorate General XIII (telecommunications, Information market and
Exploitation of Research) of the European Commission has subsidised the
development of language technology and has also led the development of basic
methods necessary for developing language technology. Additionally, the
Commission has supported the deployment of this technology, more
specifically, how to determine its adequacy for industrial requirements. As
part of that effort, the EAGLES evaluation group has extended the standards
developed by ISO (international Organisation for Standardisation) for the
software engineering industry to fit the special needs of natural language
applications. EAGLES has achieved significant success in developing a
framework that can support the evaluation of products and systems using
language. Theoretical work has been complemented by the practical
application of the framework to specific LE projects, and LE products with
diverse characteristics and functions.

Together with the EAGLES evaluation group and the European Commission,
Compuleer is organising a two-day conference: EELS (European Evaluation of
Language Systems). The purpose of EELS is to transfer the results from the
research laboratories to the industrial world, specifically to the quality
assurance specialists. At this conference the EAGLES results will be
presented: a customisable framework to produce tailored evaluations.

A workshop will describe a practical application of the framework to the
industrial deployment of a spoken dialogue system (ARISE) in a railways call
centre. Problems that participants experience when evaluating language
systems can be handled in the evaluation clinic. A description of the
problems/questions should be submitted by the participants beforehand.

The purpose of EELS is to provide the attendants with the tools to determine
if a language system satisfies their needs. EELS will contribute to the
successful deployment of LE technology on the market.

EELS: European Evaluation of Language Systems

Date: 12 and 13 April 1999

Location: De Klepperman in Hoevenlaken, The Netherlands

Costs: 1000 EURO for two days (incl. attendance at the conference,
documentation and accommodation)

More information: Compuleer

Mr. Marc Blasband

Egelinglaan 16a

3705 TC Zeist

The Netherlands

tel./fax: +31 (0)30 6992343



(under construction)

- --------------------------------------------------------------------------
- --
Egelinglaan 16A
Tel/Fax +31 30 6992343
Mail to author|Respond to list|Read more issues|LINGUIST home page|Top of issue