Validation and validity beyond Messick

  • Albert Weideman

Abstract

Following the texts of the Messick (1981: 10; 1980: 1023) formulations more closely, another representation of his well-known “Facets of validity” matrix is possible. This matrix can be read as four claims about language testing (“The technical adequacy of inferences made from test scores depends on multiple sources of empirical evidence; The appropriateness of inferences made from test scores relates to the detrimental or beneficial consequences...” and so forth). This representation still follows Messick’s argument, but rather than validity, articulates the coherence of a number of assessment concepts. Such concepts as the technical adequacy of our assessment instruments, their appropriateness, the technical meaningfulness (interpretation) of their measurements, their utility, their social impact and public defensibility indicate that we can usefully reconceptualise not only validation and validity, but all of our efforts at designing assessments responsibly. The current debates in South Africa about standardisation and equivalence can be deepened if we examine ways of going beyond conventional notions of validation and validity, and take responsible design criteria to constitute the overriding condition(s) for the development of assessment instruments.

Author Biography

Albert Weideman
Albert Weideman is professor of applied language studies in the Department of Linguistics and Language Practice, University of the Free State. He is also CEO of ICELDA, a formal partnership of four multi-lingual South African universities (UP, NWU, Free State and Stellenbosch), that designs language tests and courses. His research focuses on developing a foundational framework for working responsibly within applied linguistics.Email address: albert.weideman@ufs.ac.za
Published
2013-04-10