Language Education & Assessment

Special Issue Announcement:
Embracing Ubiquitous Technology in Plurilingual Education


Related Publications

Online Language Teaching: Crises and Creativities

Online Language Teaching: Crises and Creativities

Edited by Ursula Stickler, Martina Emke Online Language Teaching: Crises and Creativities collects creative and…
Insights into Teaching and Learning Writing

Insights into Teaching and Learning Writing

Edited by Hassan Mohebbi  & Yijen Wang  (2023) Writing is one of the most challenging skills…
Insights into Autonomy and Technology in Language Teaching

Insights into Autonomy and Technology in Language Teaching

Chun Lai  (2023) Drawing on the literature and research findings from relevant research fields, including…
Insights into Flipped Classrooms

Insights into Flipped Classrooms

Adrian Leis  (2023) This book is aimed at those interested in the flipped learning model as…
Insights into Task-Based Language Teaching

Insights into Task-Based Language Teaching

Sima Khezrlou  (2022) This book aims to offer a unique contribution to the expanding literature on…
Proceedings of the XXIst International CALL Research Conference

Proceedings of the XXIst International CALL Research Conference

Edited by Jozef Colpaert , Yijen Wang , Glenn Stockwell  (2022) The theme of the XXIst International CALL…
Insights into Professional Development in Language Teaching

Insights into Professional Development in Language Teaching

Thomas S.C. Farrell  (2022) From entering a teacher education program for initial qualifications onwards, language teachers…
Smart CALL: Personalization, Contextualization, & Socialization

Smart CALL: Personalization, Contextualization, & Socialization

Edited by Jozef Colpaert , Glenn Stockwell  (2022) The contributions in this volume focus on a…

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

DOI: 10.29140/lea.v5n1.777
Open Access

The processes of rating L2 speaking performance using an analytic rating scale – A qualitative exploration

Thuy Thai, Susan Sheehan

– In language performance tests, raters are important as their scoring decisions determine which aspects of  performance the scores represent; however, raters are considered as one of the potential sources contributing to unwanted variability in scores (Davis, 2012).


Author(s)

,

Paper type

Regular Articles

Pages

34-51

DOI

https://doi.org/10.29140/lea.v5n1.777

Year



Abstract

In language performance tests, raters are important as their scoring decisions determine which aspects of  performance the scores represent; however, raters are considered as one of the potential sources contributing to unwanted variability in scores (Davis, 2012). Although a great number of studies have been conducted to unpack how rater variability impacts on rating decisions, much still remains unclear about what raters actually do when they assess speaking performances. This paper aimed to extend our understanding of the rating process by analysing think-aloud protocols provided by 13 VSTEP speaking raters while they used an analytic rating scale to assess 15 recorded performances with varying proficiency levels. The data suggested that although all the raters seemed to experience similar stages in the rating process, differences in rating behaviour between novice raters and experienced raters exist. To finalise the scores, the raters used five different ways of deciding the scores.

Suggested citation

Susan Sheehan, Thuy Thai. (2022). The processes of rating L2 speaking performance using an analytic rating scale - A qualitative exploration. Language Education & Assessment, 5(1), 34–51. https://doi.org/10.29140/lea.v5n1.777

Please wait while flipbook is loading. For more related info, FAQs and issues please refer to documentation.

 

%d bloggers like this: