Publishing Partner: Cambridge University Press CUP Extra Publisher Login
amazon logo
More Info

New from Oxford University Press!


Oxford Handbook of Corpus Phonology

Edited by Jacques Durand, Ulrike Gut, and Gjert Kristoffersen

Offers the first detailed examination of corpus phonology and serves as a practical guide for researchers interested in compiling or using phonological corpora

New from Cambridge University Press!


The Languages of the Jews: A Sociolinguistic History

By Bernard Spolsky

A vivid commentary on Jewish survival and Jewish speech communities that will be enjoyed by the general reader, and is essential reading for students and researchers interested in the study of Middle Eastern languages, Jewish studies, and sociolinguistics.

New from Brill!


Indo-European Linguistics

New Open Access journal on Indo-European Linguistics is now available!

Summary Details

Query:   Natural language dialogue systems evaluation
Author:  gas0 Null
Submitter Email:  click here to access email
Linguistic LingField(s):   Computational Linguistics

Summary:   Ramon Lopez-Cozar Delgado
Dpto. Electronica y Tecnologia de Computadores
Universidad de Granada
18071 Granada, Espana (Spain)
Fax: +34-58-243230

Dear LINGUIST Subscribers,

A few weeks ago I sent out an E-mail inquiry on
natural language dialogue systems evaluation.
I would like to thank the following people for
their kind replies. I enclose a summary of their

Nicholas Ostler -
Jean Caelen -
Frederik Fouvry -
Hugo Zaragoza -
Gerhard Hanrieder -
Gavin E Churcher -
Philips Bouwman -
Eric Atwell -
Matthias Denecke -
Robert John Gaizauskas -
Boda Peter -
Doug Arnold -
Bill Manaris -
Maria Teresa Taboada -
Alan Biermann -
Mai Kuha -
Hans Dybkjaer -

Special thanks to Nicholas Ostler for sending "Lying in
Wait at the Heart of the Web", a very interesting
report on the development of linguistic technology in

The summary follows:

******* Interesting www sites ***********************

- The DIET project:

- Dialogue systems evaluation

- A Generic Template to evaluate integrated components
in spoken dialogue

- PARADISE: A framework for Evaluating Spoken Dialogue

- Metrics for evaluating Dialogue Strategies in a Spoken
Language System


- Tests suites for Natural Language Processing

- "End-to-end evaluation in Janus: a speech-to-speech
translation system"

********** Interesting ftp addresses *****************

************ Interesting reports **********************

- Neal J. Feit E. et al (1992): "An Evaluation Methodology
for Natural Processing Systems", Final Technical Report,
Rome Laboratory.

*************** Interesting books *********************

- "Evaluating Natural Language Processing Systems"
Karen Sparck-Jones and Julia Galliers, Springer, 1995

- "An Architecture for Voice-Dialog"
Smith, Hipp and Biermann,
Computational Linguistics, vol. 21, no. 3

Best regards,

LL Issue: 8.778
Date Posted: 24-May-1997
Original Query: Read original query


Sums main page