* * * * * * * * * * * * * * * * * * * * * * * *
LINGUIST List logo Eastern Michigan University Wayne State University *
* People & Organizations * Jobs * Calls & Conferences * Publications * Language Resources * Text & Computer Tools * Teaching & Learning * Mailing Lists * Search *
* *
LINGUIST List 19.628

Sat Feb 23 2008

Confs: Computational Ling, Lang Acquisition, Text/Corpus Ling/USA

Editor for this issue: Stephanie Morse <morselinguistlist.org>

To post to LINGUIST, use our convenient web form at http://linguistlist.org/LL/posttolinguist.html.
        1.    Anne Rimrott, Automatic Analysis of Learner Language (at CALICO 08)

Message 1: Automatic Analysis of Learner Language (at CALICO 08)
Date: 23-Feb-2008
From: Anne Rimrott <arimrottsfu.ca>
Subject: Automatic Analysis of Learner Language (at CALICO 08)
E-mail this message to a friend

Automatic Analysis of Learner Language (at CALICO 08)

Date: 18-Mar-2008 - 19-Mar-2008
Location: San Francisco, California, USA
Contact: Detmar Meurers Anne Rimrott
Contact Email: calico-workshopling.osu.edu
Meeting URL: http://purl.org/net/calico-workshop

Linguistic Field(s): Applied Linguistics; Computational Linguistics; Language
Acquisition; Text/Corpus Linguistics

Meeting Description:

Natural Language Processing has long been used to automatically analyze language
produced by language learners. While much interesting research has been
reported, it is difficult to determine the state of the art for such automatic
analyses of learner language. For example, which error types and other language
properties can be detected and diagnosed automatically? How reliably is this
done, for which kind of learner language?

These questions seem worth exploring given that for sustained progress in the
automatic analysis of learner language it arguably is essential to discuss and
compare the performance of different analysis methods, preferably on identical,
real-life data sets. As a prerequisite, it also is important to come to an
agreement on the error types and other learner language properties that are
useful and realistic to analyze.

These issues are not only relevant to NLP in Intelligent CALL but also intersect
in important ways with the research on learner corpora, the annotation schemes
developed for those, and the related Second Language Acquisition research.

In this workshop, we want to bring together researchers working on the analysis
of learner language in the broad sense, including work on annotation schemes for
learner corpora and NLP techniques used to detect learner errors and other
learner language properties.

Call for Participation and Program of the
CALICO'08 Pre-Conference Workshop on

Automatic Analysis of Learner Language:
Bridging Foreign Language Teaching Needs and NLP Possibilities


March 18 and 19, 2008
Holiday Inn Golden Gateway, San Francisco

Tuesday, March 18

9:00 - 9:10
Detmar Meurers (Ohio State University) and
Anne Rimrott (Simon Fraser University):

9:10 - 9:40
Nick Pendar and Anna Kosterina (Iowa State University):
The Challenges of Annotating Learner Language

9:40 - 10:10
Marzena Watorek (Université de Paris 8) and
Aurelia Marcus (Sinequa):
Formalizing the Second Language Learner Corpus by Means of Automatic Analysis

10:30 - 11:00
Trude Heift (Simon Fraser University)
Goals and Challenges for the Standardization of Error Typologies in Parser-based

11:00 - 11:30
Michael Gamon, Chris Brockett, William B. Dolan, Jianfeng Gao, Alexandre
Klementiev (Microsoft Research), Dmitriy Belenko (University of Illinois, Urbana
Champaign), Claudia Leacock (Butler Hill Group):
Using Statistical Techniques and Web Search to Correct ESL Errors

11:30 - 12:00
Anne Rimrott, Trude Heift (Simon Fraser University):
Classification Systems for Misspellings by Non-Native Writers

1:00 - 1:30
Mathias Schulze and Peter Wood (University of Waterloo):
Analyzing Learner Texts

1:30 - 2:00
Ghazi Abuhakema, Anna Feldman, Eileen Fitzpatrick (Montclair State University):
A New Arabic Interlanguage Database: Collection, Annotation, Analysis

2:00 - 2:30
Tony Berber Sardinha (Catholic University of Sao Paulo) and Tania Shepherd (Rio
de Janeiro State University):
Developing an Online System for Automatically Identifying Errors in Brazilian
Learner English

3:00 - 3:30
Martí Quixal and Toni Badia (Universitat Pompeu Fabra):
Exploiting Unsupervised Techniques to Predict EFL Learner Errors

3:30 - 4:00
Jennifer Foster, Joachim Wagner, and Josef van Genabith (Dublin City University):
Using Decision Trees to Detect and Classify Grammatical Errors

4:00 - 5:00
Poster Session:

Stacey Bailey and Detmar Meurers (Ohio State University):
Diagnosing Meaning Errors in Short Answers to Reading Comprehension Questions

Adriane Boyd and Detmar Meurers (Ohio State University):
On Diagnosing Word Order Errors

Markus Dickinson (Indiana University) and Chong Min Lee (Georgetown University):
Korean Particle Error Detection Via Probabilistics Parsing

Paul G Doyle, Hong Huaqing (Nanyang Technological University, Singapore):
A Variety of ''Errors''? Automated Analysis of Teacher and Pupil Talk in
Singapore Classrooms

Karin Harbusch, Gergana Itsova, Ulrich Koch, and Christine Kühner (Universität
Toward Accurate Syntactic Feedback in a Writing Lab for German-speaking
Elementary Schoolers: A Generation-based Approach

DJ Hovermale (Ohio State University):
SCALE: Spelling Correction Adapted for Learners of English

Olivier Kraif, Alexia Blanchard, Claude Ponton (LIDILEM, Université Stendhal,
Grenoble, France):
Mastering Noise and Silence in Learner Answer Processing: Simple Techniquest for
Analysis and Diagnosis

Stela Letica (Universtiy of Zagreb, Croatia):
Croatian Corpus of Learner English

Diane Napolitano, Amanda Stent (State University of New York at Stony Brook):
Techwriter: An Individualized Approach to Writing Assistance and Improvement

Hiromi Oyama, Yuji Matsumoto, Masayuki Asahara and Kosuke Sakata (Nara Institute
of Science and Technology):
Construction of an Error Information Tagged Corpus of Japanese Language Learners
and Automatic Error Detection

Wednesday, March 19

9:00 - 9:30
Heather Hilton (Université de Savoie):
Annotation and Analyses of Temporal Aspects of Spoken Fluency

9:30 - 10:00
Su-Youn Yoon, Lisa Pierce, Amanda Huensch, Eric Juul, Samantha Perkins, Richard
Sproat, Mark Hasegawa-Johnson (University of Illinois at Urbana-Champaign):
Construction of a Rated Speech Corpus of L2 Learners' Speech

10:00 - 10:30
Deryle Lonsdale, C. Ray Graham, Casey Kennington, Aaron Johnson, Jeremiah
McGhee (Brigham Young University):
Scoring an Oral Language Test Using Automatic Speech Recognition

11:00 - 11:30
Seok Bae Jang (Georgetown University), Sun-Hee Lee (Wellesley College), Sang-kyu
Seo (Yonsei University):
Annotation of Korean Learner Corpora for Particle Error Detection

11:30 - 12:00
Noriko Nagata (University of San Francisco):
Robo-Sensei's NLP-based Error Detection and Feedback Generation

12:00 - 12:30
Luiz Amaral (University of Victoria) and Detmar Meurers (Ohio State University):
Little Things with Big Effects: On the Identification and Interpretation of
Tokens for Error Diagnosis in ICALL

1:30 - 2:00
Joel Tetreault, Yoko Futagi (Educational Testing Service), Martin Chodorow
(Hunter College):
Reliability of Human Annotation of Usage Errors in Learner Text

2:00 - 2:30
Rachele De Felice and Stephen G. Pulman (Oxford University):
Automatic Detection of Preposition Errors in Learner Writing

2:30 - 3:00
Xiaofei Lu (Pennsylvania State University):
Automatic Measurement of Syntactic Complexity in Second Language Acquisition

3:30 - 5:00
Jill Burstein (Educational Testing Service), Jennifer Foster (Dublin City
University), Michael Gamon (Microsoft Research), Trude Heift (Simon Fraser
University), Detmar Meurers (Ohio State University), Lisa Michaud (Wheaton
Panel Discussion on Automatic Analysis of Learner Language: What's the Next

Abstracts and more information on the workshop can be found at

For questions, you can contact Detmar Meurers and Anne Rimrott,
organizing the event as chairs of the ICALL SIG of CALICO, at

Read more issues|LINGUIST home page|Top of issue

Please report any bad links or misclassified data

LINGUIST Homepage | Read LINGUIST | Contact us

NSF Logo

While the LINGUIST List makes every effort to ensure the linguistic relevance of sites listed
on its pages, it cannot vouch for their contents.