11/05/2026
Dear colleagues,
The Centre for English Corpus Linguistics at UCLouvain is currently running an experiment for which we need participants with experience in language assessment.
The study requires individuals who have either advanced proficiency in English or speak English as a first language (L1), and who have experience in language assessment. Participants will complete a comparative judgments task involving word combinations. In this task, you will be presented with two word combinations side-by-side and asked to judge which one better fits a given linguistic construct. There is no need to assign scores, either holistically or analytically, or to consult a rubric. Instead, you should rely on your own expertise to decide which of the two options is "better".
Each participant will be asked to complete 50 comparisons (these do not need to be completed in a single session) and to fill out a short feedback form explaining the factors that guided their decision-making process. The entire task is expected to take under 30 minutes to complete.
No prior training is required for this task. You will receive instructions on how to log in to the platform, after which you will rely on your own expertise (without using a rubric) to complete this comparative judgment task.
We are seeking participants who can commit to completing 50 comparisons and the feedback form. Participants will receive 35 euros in compensation for completing this task. This study is the first in a planned series of three. Participants who take part in this initial task will be given priority for recruitment in subsequent tasks, which will focus on longer text-based tasks, involve a greater time commitment, and offer higher compensation.
The experiment is expected to begin in the second half of May. Participants will be asked to complete the task within two weeks of receiving access to the comparative judgment platform.
Applicants should meet the following criteria:
• Advanced English proficiency or English as a first language (L1)
• Minimum of 5 years’ experience teaching ESL/EFL
• Recognised qualification in Teaching English as a Foreign/Second Language or a related field (e.g. undergradute or postgradute degree in Applied Linguistics, Language Testing and Assessment, etc.; CELTA, DELTA)
• Training in L2 writing assessment
• Experience assessing L2 writing (preferably as an examiner)
• Private access to a personal computer with an internet connection.
If you are interested in participating, please register your interest by completing the following form: https://shorturl.at/tvsHu
We will then contact you again by the second half of May with further details.
Do not hesitate to contact us by email if you have any questions ([email protected]).
Best regards,
Gabriela Vaughan & Prof. Magali Paquot