ERIC Number: ED632143
Record Type: Non-Journal
Publication Date: 2022-Apr-22
Pages: 27
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
From Clicks to Constructs: An Examination of Validity Evidence of Game-Based Indicators Derived from Theory
Feng, Tianying; Chung, Gregory K. W. K.
Grantee Submission, Paper presented at the annual meeting of the American Educational Research Association (San Diego, CA, Apr 22, 2022)
A critical issue in using fine-grained gameplay data to measure learning processes is the development of indicators and the algorithms used to derive such indicators. Successful development--that is, developing traceable, interpretable, and sensitive-to-learning indicators--requires understanding the underlying theory, how the theory is instantiated under different game conditions, and programming that considers these exigencies using fine-grained gameplay data. This study examines preliminary validity evidence on various game-based indicators (GBIs) developed from theoretical frameworks and not from unsupervised feature extraction methods. Examples of indicators are presented that represent three types of indicators: Common indicators, distance-based indicators, and games-specific indicators. For each example, the theoretical background is presented briefly, followed by a description of how the indicator design flows from the theory. Correlational analyses show how the GBIs relate to external criterion measures. Limitations and next steps are discussed.
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); Department of Education (ED); Silicon Valley Community Foundation
Authoring Institution: National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
IES Funded: Yes
Grant or Contract Numbers: R305A190433; U295A150003; S295A200004
Author Affiliations: N/A