LINGUIST List 32.1098

Fri Mar 26 2021

Calls: Comp Ling/Online

Editor for this issue: Lauren Perkins <laurenlinguistlist.org>



Date: 26-Mar-2021
From: Nikhil Krishnaswamy <nkrishnacolostate.edu>
Subject: Shared Task on VoxML Standardization
E-mail this message to a friend

Full Title: Shared Task on VoxML Standardization
Short Title: ISA-17-VoxML

Date: 15-Jun-2021 - 16-Jun-2021
Location: Groningen (virtual event), Netherlands
Contact Person: James Pustejovsky
Meeting Email: < click here to access email >
Web Site: https://sigsem.uvt.nl/isa17/

Linguistic Field(s): Computational Linguistics

Call Deadline: 21-Apr-2021

Meeting Description:

As part of a proposal to develop the VoxML modeling language into an ISO Standard for the representation of visual information, the 17th Joint ACL-ISO Workshop on Interoperable Semantic Annotation (ISA) is hosting a shared multimodal annotation. The goal of the task is to assess annotation techniques suitable for extracting habitats, affordances, and spatial relations of objects from image data.

We are supplying an annotation interface and a batch of curated images from the Visual Genome dataset showing objects in common configurations or activities. Annotators will be asked to view images, caption them, and annotate the objects, spatial relations, and activities (depicted or potential) in each image, according to a provided guideline. We ask participants in the shared task to annotate as many of the images as they can using the provided tool.

Call for Participation:

A background document on VoxML is available at: https://sigsem.uvt.nl/isa16/Pustejovsky-Krishnaswamy-LREC2016.pdf

Participants may install the annotation tool by following the instructions at: https://github.com/csu-signal/VoxML-Track-Annotation-2021. Deadline for submissions of annotations and project notes is April 21, 2021.

Annotators and teams may submit a project note (up to 4pp), discussing, but not limited to:
- reflections on the adequacy of the annotation guideline;
- facility of the annotation tool;
- properties observed in the raw image data while annotating;
- confounding examples;
- potential problems pertaining to standardization, and their solutions;
- suggested deeper investigations into other things that would be interesting to annotate (other data, other properties we should have included, etc.).

Project notes will be reviewed for presentation (oral or poster) at ISA, space permitting.

Track organizers will provide feedback on submitted annotations, observations, and analyses during the ISA workshop, followed by a discussion of the annotation effort, lessons learned (e.g., problems, gaps, suitability of the results for machine learning, automated generation, etc.), and the adequacy and expressiveness of the VoxML representation language.




Page Updated: 26-Mar-2021