LINGUIST List 25.3412

Fri Aug 29 2014

FYI: EVALITA 2014: Test Data Available on September 8th

Editor for this issue: Uliana Kazagasheva <ulianalinguistlist.org>


Date: 29-Aug-2014
From: Simonetta Montemagni <simonetta.montemagniilc.cnr.it>
Subject: EVALITA 2014: Test Data Available on September 8th
E-mail this message to a friend

EVALITA
Evaluation of NLP and Speech Tools for Italian
http://www.evalita.it/

Test data available for download on September 8th.

The 4th evaluation campaign “Evaluation of NLP and Speech Tools for Italian” - EVALITA 2014 (http://www.evalita.it) will be held on December 11 2014 in Pisa (Italy). The following tasks are being organized:
Text Tasks:
- Dependency Parsing articulated into two subtasks: Dependency Parsing for Information Extraction (DPIE) and Cross-language Dependency Parsing (CLAP) (http://www.evalita.it/2014/tasks/dep_par4IE)
- Evaluation of Events and Temporal Information (http://www.evalita.it/2014/tasks/eventi)
- Sentiment Polarity Classification (http://www.evalita.it/2014/tasks/sentipolc)
- Word Sense Disambiguation (http://www.evalita.it/2014/tasks/wsd_ls)
Speech Tasks:
- Emotion Recogniton Task (http://www.evalita.it/2014/tasks/emotion)
- Forced Alignment on Children Speech (http://www.evalita.it/2014/tasks/children)
- Human and Machine Dialect Identification from Natural Speech and Artificial Stimuli (http://www.evalita.it/2014/tasks/dialect)
- Speech Activity Detection and Speaker Localization in Domestic Environments (http://www.evalita.it/2014/tasks/saslodom)

The participation is encouraged for teams working both in academic institutions and industrial organizations.

Registration to EVALITA 2014 Tasks is open at http://www.evalita.it/Registration2014.html until September 8th 2014 when data sets for testing will be made available.

Development data for all 2014 tasks are currently available for download. Detailed instructions for data download and Tasks’ guidelines are provided in the web page of each task (linked from the EVALITA 2014 web site).

Important Dates:
- 8th September 2014: test data available, registration closes
- 15th September 2014: system results due to organizers
- 22th September 2014: assessment returned to participants
- 31st October 2014: technical reports due to organizers, early registration for AI*IA and EVALITA 2014 workshop opens
- 28th November 2014: early registration to EVALITA 2014 workshop closes
- 11 December 2014: final workshop

EVALITA-2014 Organization:
Scientific coordination:
- Cristina Bosco (University of Torino)
- Felice Dell'Orletta (Istituto di Linguistica Computazionale ''Antonio Zampolli'' - CNR, Pisa)
- Simonetta Montemagni (Istituto di Linguistica Computazionale ''Antonio Zampolli'' - CNR, Pisa)
- Maria Simi (University of Pisa)
Scientific coordination for Speech Technology Evaluation:
- Piero Cosi (Istituto di Scienze e Tecnologie della Cognizione - CNR, Padova)
- Mauro Falcone (Fondazione Ugo Bordoni)
Contact person:
Cristina Bosco (boscodi.unito.it)

Linguistic Field(s): Computational Linguistics

Page Updated: 29-Aug-2014