LINGUIST List 27.1674

Mon Apr 11 2016

Calls: Computational Ling, Text/Corpus Ling/Germany

Editor for this issue: Ashley Parker <>

Date: 11-Apr-2016
From: Annemarie Friedrich <>
Subject: 10th Linguistic Annotation Workshop
E-mail this message to a friend

Full Title: 10th Linguistic Annotation Workshop
Short Title: LAW X 2016

Date: 11-Aug-2016 - 12-Aug-2016
Location: Berlin, Germany
Contact Person: Annemarie Friedrich
Meeting Email: < click here to access email >
Web Site:

Linguistic Field(s): Computational Linguistics; Text/Corpus Linguistics

Call Deadline: 08-May-2016

Meeting Description:

Linguistic annotation of natural language corpora is the backbone of supervised methods for statistical natural language processing. It also provides valuable data for evaluation of both rule-based and supervised systems and can help formalize and study linguistic phenomena.

The LAW provides a forum for presentation and discussion of innovative research on all aspects of linguistic annotation, including creation/evaluation of annotation schemes, methods for automatic and manual annotation, use and evaluation of annotation software and frameworks, representation of linguistic data and annotations, evaluation of manual and automatically-produced annotations, etc.

We encourage submission of papers relating to this year's theme: Evaluation of Annotation Quality.

This special theme considers current practice in evaluation of linguistic annotations and its successes and failures by asking questions such as: How are we as a community measuring inter-annotator agreement to date, and are there sounder ways to measure it? How can we estimate the annotation quality of existing resources, and what can be done to document annotated data to help others assess its reliability?

We encourage submissions addressing the following topics related to the special theme:

- How agreement is measured in various (new or existing) annotation projects, and what the different scores tell us in each case
- Good acceptance thresholds for different annotation tasks and metrics, and/or how to determine them
- Previously proposed but not widely used measures for agreement or annotation quality
- Proposals for quantitative or qualitative methods to measure agreement or annotation quality
- Proposals for documentation of published resources to support their evaluation, means and methods to achieve community evaluation of linguistically-annotated resources, etc.

Workshop Chairs:

Katrin Tomanek (OpenTable)
Annemarie Friedrich (Saarland University)

Organizing Committee:

Stefanie Dipper (Ruhr University Bochum)
Chu-Ren Huang (The Hong Kong Polytechnic University)
Nancy Ide (Vassar College)
Lori Levin (Carnegie-Mellon University)
Adam Meyers (New York University)
Antonio Pareja-Lora (Universidad Complutense de Madrid / ATLAS, UNED)
Massimo Poesio (University of Trento)
Sameer Pradhan (Boulder Learning, Inc.)
Ines Rehbein (Saarland University)
Manfred Stede (University of Potsdam)
Fei Xia (University of Washington)
Nianwen Xue (Brandeis University)
Heike Zinsmeister (University of Hamburg)

Call for Papers:

Submissions and Reviewing:

Submissions should report original and unpublished research on topics of interest for the workshop. Accepted papers are expected to be presented at the workshop, and will be published in the workshop proceedings. They should emphasize obtained results rather than intended work, and should indicate clearly the state of completion of the reported results.

A paper accepted for presentation at the workshop must not be or have been presented at any other meeting with publicly available proceedings.

The maximum length is eight (8) pages of content for long papers and four (4) pages of content for short papers, plus up to two (2) pages of references. At the workshop, papers will be presented as oral presentations, posters or systems demonstrations.:

** Please see workshop web site for further details **

If you have any questions, please feel free to contact the program co-chairs (

All submission deadlines are at 11:59 p.m. PST
8 May 2016: Workshop Paper Due Date
5 June 2016: Notification of Acceptance
22 June 2016: Camera-ready papers due
11 August 2016: Workshop Date

Page Updated: 11-Apr-2016