* * * * * * * * * * * * * * * * * * * * * * * *
LINGUIST List logo Eastern Michigan University Wayne State University *
* People & Organizations * Jobs * Calls & Conferences * Publications * Language Resources * Text & Computer Tools * Teaching & Learning * Mailing Lists * Search *
* *
LINGUIST List 22.352

Thu Jan 20 2011

FYI: Call for Interest: EVALITA 2011

Editor for this issue: Brent Miller <brentlinguistlist.org>

To post to LINGUIST, use our convenient web form at http://linguistlist.org/LL/posttolinguist.cfm.
        1.     Manuela Speranza , Call for Interest: EVALITA 2011

Message 1: Call for Interest: EVALITA 2011
Date: 18-Jan-2011
From: Manuela Speranza <mansperafbk.eu>
Subject: Call for Interest: EVALITA 2011
E-mail this message to a friend

EVALITA 2011 - Call for Interest
Evaluation of NLP and Speech Tools for Italian
January 2011

Following the success obtained by the previous editions, we are pleased to
announce Evalita 2011, the third evaluation campaign of Natural Language
Processing and Speech tools for Italian.

The general objective of Evalita (http://evalita.fbk.eu) is to promote the
development of language technologies for the Italian language, providing a
shared framework where different systems and approaches can be evaluated in
a consistent manner.

In particular, we intend to organise the following tasks:

Text tasks
- Parsing (Main Task)
- Domain Adaptation for Dependency Parsing (Pilot Task)
- Named Entity Recognition on Transcribed Broadcast News
- Cross-document Coreference Resolution of Named Person Entities
- Anaphora Resolution
- Super Sense Tagging
- Frame Labeling over Italian texts
- Lemmatisation

Speech tasks
- Automatic Speech Recognition - Large Vocabulary Transcription
- Spoken Dialogue Systems Evaluation
- Forced Alignment on Spontaneous Speech
- Voice Applications on Mobile - Student Contest

As with other international evaluation campaigns, guidelines describing the
different tasks will be distributed among the participants. Participants
will also be provided with training data and will have the chance to test
their systems with the evaluation metrics and procedures to be used in the
formal evaluation. The results of the evaluation will be disseminated at
the final workshop which will be organized in conjunction with the next
AISV Conference (date and location to be announced).

We invite participation from both academic institutions and industrial

Please indicate your intention to participate and the specific task(s) you
are interested in, by filling out the form at the following link:


Your expressions of interest will be very important to help us organising
the evaluation campaign.

Important dates
- 1st March 2011: on-line registration opens
- 20th May 2011: development data available to participants
- 4th October 2011: test data available, registration closes
- 14th October 2011: system results due to organizers
- 28th October 2011: assessment returned to participants
- 24th November 2011: technical reports due to organizers
- January/February 2012: final workshop

Scientific coordination:

Bernardo Magnini (FBK-irst, Trento) and Emanuele Pianta (FBK-irst and
CELCT, Trento)

Scientific coordination for Speech Technology Evaluation:

Francesco Cutugno (Uni. Napoli ''Federico II'') and Mauro Falcone
(Fondazione Ugo Bordoni, Roma)

Task Organization:

* Parsing (Main task): Cristina Bosco (Uni. Torino) and Alessandro Mazzei
(Uni. Torino)
* Domain Adaptation for Dependency Parsing (Pilot Task): Felice
dell'Orletta (ILC-CNR, Pisa), Simonetta Montemagni (ILC-CNR, Pisa) and
Giulia Venturi (ILC-CNR, Pisa)
* Named Entity Recognition on Transcribed Broadcast News: Valentina
Bartalesi Lenzi (CELCT, Trento), Manuela Speranza (FBK-irst, Trento) and
Rachele Sprugnoli (CELCT, Trento)
* Co-reference: Luisa Bentivogli (FBK-irst, Trento) and Alessandro
Marchetti (CELCT, Trento)
* Anaphora Resolution: Massimo Poesio (Uni. Trento)
* Super Sense Tagging: Stefano Dei Rossi, Giulia Di Pietro and Maria Simi
(Uni. Pisa)
* Frame Labeling over Italian texts: Roberto Basili (Uni.Roma Tor Vergata)
and Alessandro Lenci (Uni. Pisa)
* Lemmatisation: Fabio Tamburini (Uni. Bologna)
* ASR - Large vocabulary transcription: Fabio Brugnara, Roberto Gretter and
Marco Matassoni (FBK-irst, Trento)
* Spoken Dialogue Systems Evaluation: Silvia Quarteroni (Politecnico di
Milano), Giuseppe Riccardi (Uni. Trento) and Pierluigi Roberti (Interactive
* Forced Alignment on Spontaneous speech: Francesco Cutugno (Uni. Napoli),
Dino Seppi (Uni. Leuven), Antonio Origlia (Uni. Napoli)
* Voice Applications on Mobile - Student Contest: Francesco Cutugno (Uni.
Napoli), Roberto Pieraccini (SpeechCycle, New York, USA)

Contact: Manuela Speranza, mansperafbk.eu

Linguistic Field(s): Computational Linguistics

Read more issues|LINGUIST home page|Top of issue

Page Updated: 20-Jan-2011

Supported in part by the National Science Foundation       About LINGUIST    |   Contact Us       ILIT Logo
While the LINGUIST List makes every effort to ensure the linguistic relevance of sites listed on its pages, it cannot vouch for their contents.