LINGUIST List 31.1145

Wed Mar 25 2020

Confs: Computational Linguistics/Spain

Editor for this issue: Lauren Perkins <>

Date: 24-Mar-2020
From: Preslav Nakov <>
Subject: CLEF-2020 CheckThat! Lab
E-mail this message to a friend

CLEF-2020 CheckThat! Lab
Short Title: CheckThat!

Date: 20-Sep-2020 - 25-Sep-2020
Location: Barcelona, Spain
Contact: Preslav Nakov
Contact Email: < click here to access email >
Meeting URL:

Linguistic Field(s): Computational Linguistics

Subject Language(s): English

Language Family(ies): Germanic

Meeting Description:

CLEF-2020 CheckThat! Lab (Tasks in English): Call for Participation (with COVID-19 tweets)

** Call for Participation **

We invite you to take part in the CLEF-2020 CheckThat! Lab on Automatic Identification and Verification of Claims in Social Media. Three tasks are available in English, one of which features a dataset about COVID-19:

Task 1: Check-Worthiness on Tweets. The task asks to rank a stream of tweets on a number of topics, including COVID-19, according to their check-worthiness. (

Task 2: Verified Claim Retrieval. Given a check-worthy claim and a set of verified claims, rank the verified claims, so that those that verify the input claim (or a sub-claim in it) are ranked on top (

Task 5: Check-Worthiness on Debates. Given a debate segmented into sentences, together with speaker information, prioritize sentences for fact-checking (

The CheckThat! Lab also has three tasks in Arabic (check the Lab website for details).

The Lab will be held in conjunction with CLEF 2020 in Thessaloniki, Greece.

How to Participate:

1. Register for the Fact Checking Lab at
2. Join the Google Group for the task:!forum/clef-factcheck
3. Download the datasets and the tools:
4. Prepare/train your models.
5. Submit your results on the test sets.
6. Submit a paper describing your approach.
7. Come to Thessaloniki, Greece and present your approach.

Important Dates:
Mar 20 Beginning of the evaluation cycle for the English tasks
May 1 Test sets released
May 10 Submission deadline
May 24 Paper submission
Jun 28 Camera-ready paper submission
Sep 22-25 Conference (Thessaloniki, Greece)

English Tasks Organizers:
Alex Nikolov, Sofia University
Firoj Alam, QCRI, HBKU
Nikolay Babulkov, Sofia University
Shaden Shaar, QCRI, HBKU
Giovanni Da San Martino, QCRI, HBKU
Preslav Nakov, QCRI, HBKU

Page Updated: 25-Mar-2020