* * * * * * * * * * * * * * * * * * * * * * * *
LINGUIST List logo Eastern Michigan University Wayne State University *
* People & Organizations * Jobs * Calls & Conferences * Publications * Language Resources * Text & Computer Tools * Teaching & Learning * Mailing Lists * Search *
* *
LINGUIST List 19.1095

Wed Apr 02 2008

FYI: Generation Challenges 2009: Announcement

Editor for this issue: Matthew Lahrman <mattlinguistlist.org>

To post to LINGUIST, use our convenient web form at http://linguistlist.org/LL/posttolinguist.html.
        1.    Albert Gatt, Generation Challenges 2009: Announcement

Message 1: Generation Challenges 2009: Announcement
Date: 02-Apr-2008
From: Albert Gatt <a.gattabdn.ac.uk>
Subject: Generation Challenges 2009: Announcement
E-mail this message to a friend

Announcement and First Call for Task Proposals


To be held in conjunction with ENLG 2009.

Following the NSF/SIGGEN Workshop on Shared Tasks and Comparative
Evaluation in NLG in April 2007
(http://www.ling.ohio-state.edu/~mwhite/nlgeval07/), and the INLG'06
Special Session on Sharing Data and Comparative Evaluation
there has recently been a lot of activity involving shared tasks in Natural
Language Generation (NLG). The Pilot Attribute Selection for Generating
Referring Expressions (ASGRE) Challenge took place between May and
September 2007; the Referring Expression Generation (REG) Challenge
2008 is currently underway; and other challenges are being prepared.

To provide a common forum for these activities, we are organising
Generation Challenges 2009, an umbrella event designed to bring together a
variety of shared-task evaluation efforts that involve the generation of
natural language. The following is a provisional list of tasks that have
been proposed so far:

1. The GIVE Challenge (Koller, Byron, Moore, Oberlander & Striegnitz):
Generation of natural-language instructions to aid human task-solving in a
virtual environment.

2. GREC Task (Belz, Gatt & Viethen): Generation of references to named
entities in discourse; exact task definition to be announced.

3. TUNA Progress Test (Gatt & Belz): An opportunity to improve on REG'08
Task 3, i.e. mapping from TUNA domain representations to referring expressions.

At this point, we invite any team of researchers interested in organising a
shared task as part of the Generation Challenges 2009 event to submit a
task proposal.

This is not intended to be a selective process. Anyone interested in
running a shared task as part of Generation Challenges 2009 is in principle
welcome to do so. We would simply like to get an idea of how many tasks
there are likely to be for organisational purposes, and also to be able to
offer advice and support where needed. In the unlikely event that more
tasks are proposed than can be accommodated, we would make a selection
together with the ENLG'09 organisers.

Each team of task organisers will be reponsible for organising and
evaluating their task. The Generation Challenges 2009 coordinators will
merely coordinate issues relating to the ENLG'09 special session,
presentations and reports.

Please send task proposals to gre-stecitri.brighton.ac.uk by 31 May 2008.
Please bear in mind the timeline below, and include information regarding
organisers, task description, size and state of completion of data to be
used, evaluation plans and provisional timeline.

Don't hesitate to get in touch with any questions. Best wishes,

Anja Belz and Albert Gatt

Generation Challenges 2009 Timeline:

Deadline for submission of task proposals 31 May 2008
Recommended first call for participation Jun 2008
Recommended availability of training data Jul-Aug 2008
Recommended evaluation period Feb 2009
Expected deadline for camera-ready reports end Feb 2009
ENLG'09 (provisional) 30-31 March 2009

Linguistic Field(s): Computational Linguistics

This Year the LINGUIST List hopes to raise $60,000. This money will go to help keep 
the List running by supporting all of our Student Editors for the coming year.

See below for donation instructions, and don't forget to check out our Fund Drive 
2008 LINGUIST List Circus and join us on our many shows!


There are many ways to donate to LINGUIST!

You can donate right now using our secure credit card form at  

Alternatively you can also pledge right now and pay later. To do so, go to:

For all information on donating and pledging, including information on how to 
donate by check, money order, or wire transfer, please visit:

The LINGUIST List is under the umbrella of Eastern Michigan University and as such 
can receive donations through the EMU Foundation, which is a registered 501(c) 
Non Profit organization. Our Federal Tax number is 38-6005986. These donations 
can be offset against your federal and sometimes your state tax return (U.S. tax 
payers only). For more information visit the IRS Web-Site, or contact your 
financial advisor.

Many companies also offer a gift matching program, such that they will match any 
gift you make to a non-profit organization. Normally this entails your contacting 
your human resources department and sending us a form that the EMU Foundation fills 
in and returns to your employer. This is generally a simple administrative procedure 
that doubles the value of your gift to LINGUIST, without costing you an extra penny. 
Please take a moment to check if your company operates such a program.

Thank you very much for your support of LINGUIST!


Read more issues|LINGUIST home page|Top of issue

Please report any bad links or misclassified data

LINGUIST Homepage | Read LINGUIST | Contact us

NSF Logo

While the LINGUIST List makes every effort to ensure the linguistic relevance of sites listed
on its pages, it cannot vouch for their contents.