LINGUIST List 27.68

Tue Jan 05 2016

Confs: Computational Ling/Slovenia

Editor for this issue: Ashley Parker <>

Date: 19-Dec-2015
From: António Branco <>
Subject: Workshop on Research Results Reproducibility and Resources Citation in Science and Technology
E-mail this message to a friend

Workshop on Research Results Reproducibility and Resources Citation in Science and Technology
Short Title: 4REAL Workshop

Date: 28-May-2016 - 28-May-2016
Location: Portorož, Slovenia
Contact: António Branco
Contact Email: < click here to access email >
Meeting URL:

Linguistic Field(s): Computational Linguistics

Meeting Description:

4REAL Workshop
Workshop on Research Results Reproducibility and
Resources Citation in Science and Technology of Language

28 May 2016
Portorož, Slovenia

Collocated with LREC2016
10th Language Resources and Evaluation Conference

The discussion on research integrity has grown in importance as the resources allocated to and societal impact of scientific activities have been expanding (e.g. Stodden, 2013, Aarts et al., 2015), to the point that it has recently crossed the borders of the research world and made its appearance in important mass media and was brought to the attention of the general public (e.g. Nail and Gautam, 2011, Zimmer, 2012, Begley and Sharon 2012, The Economist, 2013).

The immediate motivation for this increased interest is to be found in a number of factors, including the realization that for some published results, their replication is not being obtained (e.g. Prinz et al., 2011; Belgley and Ellis, 2012); that there may be problems with the commonly accepted reviewing procedures, where deliberately falsified submissions, with fabricated errors and fake authors, get accepted even in respectable journals (e.g. Bohannon, 2013); that the expectation of researchers vis a vis misconduct, as revealed in inquiries to scientists on questionable practices, scores higher than one might expect or would be ready to accept (e.g. Fanelli, 2009); among several others.

Making justice to and building on the inherent ethos of scientific inquiry, this issue has been under thorough inquiry leading to a scrutiny on its possible immediate causes and underlying factors, and to initiatives to respond to its challenge, namely by the setting up of dedicated conferences (e.g. WCRI – World Conference on Research Integrity), dedicated journals (e.g. RIPR – Research Integrity and Peer review), support platforms (e.g. COS – Center for Open Science), revised and more stringent procedures (e.g. Nature, 2013), batch replication studies (e.g. Aarts et al, 2015), investigations on misconduct (e.g. Hvistendahl, 2013), etc.

This workshop seeks to foster the discussion and the advancement on a topic that has been so far given insufficient attention in the research area of language processing tools and resources (Branco, 2013, Fokkens et al., 2013) and that has been an important topic emerging in other scientific areas. That is the topic of the reproducibility of research results and the citation of resources, and its impact on research integrity.

Organization committee:

António Branco (University of Lisbon)
Nicoletta Calzolari (ILC)
Khalid Choukri (ELRA)

Program committee:

António Branco (University of Lisbon)
Iryna Gurevych (Universität Darmstadt)
Isabel Trancoso (INESC)
Joseph Mariani (CNRS/LIMSI)
Justus Roux (NWVU)
Khalid Choukri (ELRA)
Maria Gavrilidou (ILSP)
Marko Grobelnik (Jozef Stefan Institute)
Marko Tadic (University of Zagreb)
Mike Rosner (University of Malta)
Nicoletta Calzolari (ILC)
Nick Campbell (Trinity College Dublin)
Senja Pollak (Jozef Stefan Institute)
Stelios Piperidis (ILSP)
Steven Krauwer (University of Utrecht)
Thierry Declerck (DFKI)
Torsten Zesch (University of Duisburg-Essen)
Yohei Murakami (Language Grid Japan)

Page Updated: 05-Jan-2016