LINGUIST List 30.1502

Thu Apr 04 2019

Confs: Computational Linguistics/Switzerland

Editor for this issue: Everett Green <>

***************** LINGUIST List Support *****************

Fund Drive 2019
29 years of LINGUIST List!
Please support the LL editors and operation with a donation at:

Date: 30-Mar-2019
From: Preslav Nakov <>
Subject: CLEF-2019 Fact Checking Lab
E-mail this message to a friend

CLEF-2019 Fact Checking Lab
Short Title: CheckThat! 2019

Date: 09-Sep-2019 - 12-Sep-2019
Location: Lugano, Switzerland
Contact: Preslav Nakov
Contact Email: < click here to access email >
Meeting URL:

Linguistic Field(s): Computational Linguistics

Meeting Description:

CLEF-2019 FACT CHECKING LAB: Call for Participation


Call for Participation:


We invite you to take part in our shared task on the identification and verification of claims in political debates. Two tasks, available in English and Arabic, are included:

Task 1: Check-Worthiness. Predict which claim in a text should be prioritized for fact-checking. In particular, given a debate, the goal is to produce a ranked list of its sentences based on their worthiness for fact checking. This task will run inEnglish.

Task 2: Factuality and Evidence.

Identify which of an input set of Web pages (and passages of those Web pages) can be useful in assisting a human in fact-checking a claim. In particular, given a claim associated with a set of Web pages potentially relevant to the claim, classify and rank the pages based on usefulness for fact-checking, determine which passage of those pages were actually useful, and finally, determine the claim factuality. This task will run in Arabic.

Our lab is held in conjunction with CLEF 2019 in Lugano, Switzerland.

How to Participate:

1. Register for the Fact Checking Lab at:

2. Join the Google Group for the task:!forum/clef-factcheck

3. Download the datasets and tools from

4. Train you models to approach either or both tasks.

5. Submit your results on the test sets.

6. Submit a paper describing your approach.

7. Come to Lugano and present your approach.

Important Dates:

Apr 26
Registration closes

Apr 27
Beginning of evaluation cycle for Task 1

May 3
End of evaluation cycle for Task 1

Apr 27
Beginning of evaluation cycle for Task 2

May 10
End of evaluation cycle for Task 2

May 24
Paper submission

Jun 7
Camera-ready paper submission

Sep 9-12
Conference (Lugano, Switzerland)

Page Updated: 04-Apr-2019