Published in association
with the JALT CALL SIG
About this Journal
Information for Authors
Related Publications
Online Language Teaching: Crises and Creativities
Insights into Teaching and Learning Writing
Insights into Autonomy and Technology in Language Teaching
Insights into Flipped Classrooms
Insights into Task-Based Language Teaching
Proceedings of the XXIst International CALL Research Conference
Insights into Professional Development in Language Teaching
Smart CALL: Personalization, Contextualization, & Socialization


This work is licensed under a Creative Commons Attribution 4.0 International License.

An evaluation of automated writing assessment
Craig Hagerman
– This paper describes research done to empirically study the efficacy of using Criterion, a commercial web-based writing evaluation platform, as a revision aid, especially within a class following the Process Writing pedagogy.
Author(s) | |
---|---|
Paper type | Post-Conference Regular Articles |
Pages | 271-292 |
DOI | |
Year |
Abstract
This paper describes research done to empirically study the efficacy of using Criterion, a commercial web-based writing evaluation platform, as a revision aid, especially within a class following the Process Writing pedagogy. This paper first describes the background and rationale for Criterion automated writing evaluation, the Process Writing approach, as well as the natural language processing techniques used by Criterion. In this study an essay was submitted to Criterion multiple times with variations in a single feature each time. By logging the results and comparing how Criterion scored each submission it is possible to determine what components of an essay influence Criterion’s scoring. The conclusions from these results suggest that Criterion alone is not an adequate revision aid for the developing writer.
Suggested citation
Craig Hagerman. (2011). An evaluation of automated writing assessment. The JALT CALL Journal, 7(3), 271–292. https://doi.org/10.29140/jaltcall.v7n3.122Please wait while flipbook is loading. For more related info, FAQs and issues please refer to documentation.