LINGUIST List 36.2182
Wed Jul 16 2025
Software: LingJudge – A Platform for Collecting Linguistic Judgment Data
Editor for this issue: Daniel Swanson <daniellinguistlist.org>
Date: 15-Jul-2025
From: Tommaso Sgrizzi <tommaso.sgrizziiusspavia.it>
Subject: LingJudge – A Platform for Collecting Linguistic Judgment Data
E-mail this message to a friend
LingJudge (www.lingjudge.eu) is a free-to-use, MIT-licensed, Django-based platform designed for collecting linguistic judgments from native speakers, created to support experimental and exploratory research in linguistics. It offers a clean, intuitive interface for both researchers and participants, streamlining the workflow of designing, distributing, and collecting structured judgment tasks.
Key Features
Supported Task Types:
* Likert Scale: Sentence ratings on a customizable scale (2–10 points), with researcher-defined endpoints (e.g., "ungrammatical" ↔ "grammatical").
* Forced Choice: Participants choose between two sentences (with or without context), allowing fine-grained grammaticality contrasts or pragmatic judgments.
Task Creation:
* Create tasks via a simple web form.
* Add items individually or upload in bulk using CSV.
* Include task instructions, set the target language, randomize item order, and preview the task before publishing.
Participant Experience:
* Native Language Filtering: The task feed is personalized—participants only see tasks matching their registered native language(s).
* Item-by-Item Flow: Tasks are presented one item at a time, with a progress bar and simple navigation.
* Completion Time Tracking: Response times are logged for each participant.
Results & Data:
* Researchers can download results as CSV files, including metadata such as user ID, native languages, response times, and timestamps.
* Results are grouped by participant and include all relevant task and item details.
User Profiles & Access:
* Registration includes native language(s), date of birth, and optional affiliation.
* Authenticated users have access to a personal dashboard for task creation, participation, results management, and profile editing.
* Users cannot view or participate in their own tasks, and cannot repeat tasks they have already completed.
Privacy & Participation:
* Only authenticated users can create or complete tasks.
* No personal data is shown publicly—user IDs are stored internally for result tracking.
* The platform is free to use for both researchers and participants.
Email Alerts:
* When a new task is published, all users with a matching native language receive an email notification informing them that a new task is available.
* Notifications can be easily disabled from the user’s profile settings.
LingJudge is now fully operational and available at www.lingjudge.eu.
It's open for anyone to explore it, use it in their research or teaching, and share it with students and colleagues.
Feedback on features, bugs, or new use cases is always welcome!
Linguistic Field(s): Applied Linguistics
General Linguistics
Psycholinguistics
Syntax
Page Updated: 16-Jul-2025
LINGUIST List is supported by the following publishers: