NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: ED649919
Record Type: Non-Journal
Publication Date: 2024-Apr
Pages: 33
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
External Correlates of Adult Digital Problem-Solving Process: An Empirical Analysis of PIAAC PSTRE Action Sequences
Susu Zhang; Xueying Tang; Qiwei He; Jingchen Liu; Zhiliang Ying
Grantee Submission, Zeitschrift für Psychologie v232 n2 p120-136 2024
Computerized assessments and interactive simulation tasks are increasingly popular and afford the collection of process data, i.e., an examinee's sequence of actions (e.g., clickstreams, keystrokes) that arises from interactions with each task. Action sequence data contain rich information on the problem-solving process but are in a nonstandard, variable-length discrete sequence format. Two methods that directly extract features from the raw action sequences, namely multidimensional scaling and sequence-to-sequence autoencoders, produce multidimensional numerical features that summarize original sequence information. This study explores the utility of action sequence features in understanding how problem-solving behavior relates to cognitive proficiencies and demographic characteristics. This is empirically illustrated with the process data from the 2012 PIAAC PSTRE digital assessment. Regularized regression results showed that action sequence features are more predictive of examinees' demographic and cognitive characteristics compared to final outcomes. Partial least squares analysis further aided the identification of behavioral patterns systematically associated with demographic/cognitive characteristics.
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); National Science Foundation (NSF), Division of Social and Economic Sciences (SES); National Science Foundation (NSF), Division of Mathematical Sciences (DMS)
Authoring Institution: N/A
Identifiers - Location: United Kingdom (England); United Kingdom (Northern Ireland); United States; Japan; Netherlands; Ireland
Identifiers - Assessments and Surveys: Program for the International Assessment of Adult Competencies (PIAAC)
IES Funded: Yes
Grant or Contract Numbers: R305A210344; 1826540; 2119938; 2310664