Published in association
with the JALT VOCAB SIG
About this Journal
Information for Authors
Related Publications
Online Language Teaching: Crises and Creativities
Insights into Teaching and Learning Writing
Insights into Autonomy and Technology in Language Teaching
Insights into Flipped Classrooms
Insights into Task-Based Language Teaching
Proceedings of the XXIst International CALL Research Conference
Insights into Professional Development in Language Teaching
Smart CALL: Personalization, Contextualization, & Socialization

Rater judgments and word difficulty: Conceptualizing the substantive validity of the VST
Derek N. Canning, Stuart McLean, Joseph P. Vitta
– The substantive component of construct validity requires a confrontation between empirical test results and content relevance.
Author(s) | |
---|---|
Paper type | Regular Article |
Pages | 30-37 |
DOI | |
Year |
Abstract
The substantive component of construct validity requires a confrontation between empirical test results and content relevance. The Vocabulary Size Test (VST) has been extensively validated in terms of empirical results. Less is known, however, about expert judgments of content relevance. The VST was constructed and validated according to the principle that frequency underlies vocabulary acquisition. This does not mean, however, that the two are equivalent. To better understand the construct of word difficulty as it is measured in VSTs, the results of two Rasch analyses, one on the VST, the other a Multi Facet Rasch Model (MFRM) of a questionnaire distributed to education practitioners were correlated (n = 80, r = 0.67, p < 0.001, 95% CI = [0.53, 0.77]). Semi-structured interviews were then conducted to explore how practitioners understand the concept of word difficulty. Findings indicate that word difficulty is understood to encompass more than frequency, validating recent research into the predictive power of lexical sophistication variables.
[single-article-view-pdf-block journal="VLI" year="2022" volume="11" number="2" pages="30-37" ojs_reference="v03" authors="Canning, D. N., McLean, S., & Vitta, J. P." title="Rater Judgments and Word Difficulty: Conceptualizing the Substantive Validity of the VST"]