Measuring Motivation to Take Low-Stakes Large-Scale Test: New Model Based on Analyses of "Participant-Own-Defined" Missingness.

Content Provider	Europe PMC
Author	Liu, Yuan Hau, Kit-Tai
Copyright Year	2020
Description	In large-scale low-stake assessment such as the Programme for International Student Assessment (PISA), students may skip items (missingness) which are within their ability to complete. The detection and taking care of these noneffortful responses, as a measure of test-taking motivation, is an important issue in modern psychometric models. Traditional approaches based on questionnaires and item response theory may have different limitations. In the present research, we proposed a new way by directly using “participant-own-defined” missing item information (user missingness) in a zero-inflated Poisson model. An empirical study using the PISA 2015 data (eight representative economies in two cultures) and another simulation study were conducted to validate our new approach. Results indicated that our model could successfully capture test-taking motivation. We also found that the Confucian students had lower user missingness irrespective of item positions as compared with their Western counterparts.
Abstract	In large-scale low-stake assessment such as the Programme for InternationalStudent Assessment (PISA), students may skip items (missingness) which arewithin their ability to complete. The detection and taking care of thesenoneffortful responses, as a measure of test-taking motivation, is an importantissue in modern psychometric models. Traditional approaches based onquestionnaires and item response theory may have different limitations. In thepresent research, we proposed a new way by directly using“participant-own-defined” missing item information (user missingness) in azero-inflated Poisson model. An empirical study using the PISA 2015 data (eightrepresentative economies in two cultures) and another simulation study wereconducted to validate our new approach. Results indicated that our model couldsuccessfully capture test-taking motivation. We also found that the Confucianstudents had lower user missingness irrespective of item positions as comparedwith their Western counterparts.
Related Links	https://europepmc.org/backend/ptpmcrender.fcgi?accid=PMC7565118&blobtype=pdf
ISSN	00131644
Volume Number	80
DOI	10.1177/0013164420911972
PubMed Central reference number	PMC7565118
Issue Number	6
PubMed reference number	33116329
Journal	Educational and Psychological Measurement [Educ Psychol Meas]
e-ISSN	15523888
Language	English
Publisher	SAGE Publications
Publisher Date	2020-03-22
Publisher Place	Sage CA: Los Angeles, CA
Access Restriction	Open
Rights License	© The Author(s) 2020
Subject Keyword	test-taking motivation user missingness zero-inflated Poisson model position effect culture
Content Type	Text
Resource Type	Article
Subject	Applied Mathematics Education Developmental and Educational Psychology Applied Psychology