LINGUIST List 22.352 Thu Jan 20 2011 FYI: Call for Interest: EVALITA 2011 Editor for this issue: Brent Miller <brentlinguistlist.org> To post to LINGUIST, use our convenient web form at http://linguistlist.org/LL/posttolinguist.cfm. Directory         1.     Manuela Speranza , Call for Interest: EVALITA 2011 Message 1: Call for Interest: EVALITA 2011 Date: 18-Jan-2011 From: Manuela Speranza <mansperafbk.eu> Subject: Call for Interest: EVALITA 2011 E-mail this message to a friend EVALITA 2011 - Call for Interest Evaluation of NLP and Speech Tools for Italian January 2011 Following the success obtained by the previous editions, we are pleased to announce Evalita 2011, the third evaluation campaign of Natural Language Processing and Speech tools for Italian. The general objective of Evalita (http://evalita.fbk.eu) is to promote the development of language technologies for the Italian language, providing a shared framework where different systems and approaches can be evaluated in a consistent manner. In particular, we intend to organise the following tasks: Text tasks - Parsing (Main Task) - Domain Adaptation for Dependency Parsing (Pilot Task) - Named Entity Recognition on Transcribed Broadcast News - Cross-document Coreference Resolution of Named Person Entities - Anaphora Resolution - Super Sense Tagging - Frame Labeling over Italian texts - Lemmatisation Speech tasks - Automatic Speech Recognition - Large Vocabulary Transcription - Spoken Dialogue Systems Evaluation - Forced Alignment on Spontaneous Speech - Voice Applications on Mobile - Student Contest As with other international evaluation campaigns, guidelines describing the different tasks will be distributed among the participants. Participants will also be provided with training data and will have the chance to test their systems with the evaluation metrics and procedures to be used in the formal evaluation. The results of the evaluation will be disseminated at the final workshop which will be organized in conjunction with the next AISV Conference (date and location to be announced). We invite participation from both academic institutions and industrial organizations. Please indicate your intention to participate and the specific task(s) you are interested in, by filling out the form at the following link: http://evalita.fbk.eu/CFI2011.html Your expressions of interest will be very important to help us organising the evaluation campaign. Important dates - 1st March 2011: on-line registration opens - 20th May 2011: development data available to participants - 4th October 2011: test data available, registration closes - 14th October 2011: system results due to organizers - 28th October 2011: assessment returned to participants - 24th November 2011: technical reports due to organizers - January/February 2012: final workshop Scientific coordination: Bernardo Magnini (FBK-irst, Trento) and Emanuele Pianta (FBK-irst and CELCT, Trento) Scientific coordination for Speech Technology Evaluation: Francesco Cutugno (Uni. Napoli ''Federico II'') and Mauro Falcone (Fondazione Ugo Bordoni, Roma) Task Organization: * Parsing (Main task): Cristina Bosco (Uni. Torino) and Alessandro Mazzei (Uni. Torino) * Domain Adaptation for Dependency Parsing (Pilot Task): Felice dell'Orletta (ILC-CNR, Pisa), Simonetta Montemagni (ILC-CNR, Pisa) and Giulia Venturi (ILC-CNR, Pisa) * Named Entity Recognition on Transcribed Broadcast News: Valentina Bartalesi Lenzi (CELCT, Trento), Manuela Speranza (FBK-irst, Trento) and Rachele Sprugnoli (CELCT, Trento) * Co-reference: Luisa Bentivogli (FBK-irst, Trento) and Alessandro Marchetti (CELCT, Trento) * Anaphora Resolution: Massimo Poesio (Uni. Trento) * Super Sense Tagging: Stefano Dei Rossi, Giulia Di Pietro and Maria Simi (Uni. Pisa) * Frame Labeling over Italian texts: Roberto Basili (Uni.Roma Tor Vergata) and Alessandro Lenci (Uni. Pisa) * Lemmatisation: Fabio Tamburini (Uni. Bologna) * ASR - Large vocabulary transcription: Fabio Brugnara, Roberto Gretter and Marco Matassoni (FBK-irst, Trento) * Spoken Dialogue Systems Evaluation: Silvia Quarteroni (Politecnico di Milano), Giuseppe Riccardi (Uni. Trento) and Pierluigi Roberti (Interactive Media) * Forced Alignment on Spontaneous speech: Francesco Cutugno (Uni. Napoli), Dino Seppi (Uni. Leuven), Antonio Origlia (Uni. Napoli) * Voice Applications on Mobile - Student Contest: Francesco Cutugno (Uni. Napoli), Roberto Pieraccini (SpeechCycle, New York, USA) Contact: Manuela Speranza, mansperafbk.eu Linguistic Field(s): Computational Linguistics Read more issues|LINGUIST home page|Top of issue Page Updated: 20-Jan-2011       About LINGUIST    |   Contact Us       While the LINGUIST List makes every effort to ensure the linguistic relevance of sites listed on its pages, it cannot vouch for their contents.