Several studies have been published on disengaged test respondents, and others have analyzed disengaged survey respondents separately. For many large-scale assessments, students answer questionnaire and test items in succession. This study examines the percentage of students who continuously engage in disengaged responding behaviors across…

Log files from computer-based assessment can help better understand respondents' behaviours and cognitive strategies. Analysis of timing information from Programme for the International Assessment of Adult Competencies (PIAAC) reveals large differences in the time participants take to answer assessment items, as well as large country differences…

The present study used process data from a computer-based problem-solving task as indications of behavioural level of test-taking effort, and explored how behavioural item-level effort related to overall test performance and self-reported effort. Variables were extracted from raw process data and clustered. Four distinct clusters were obtained and…

This paper explores the impact of test-taking conditions on the quality of the Programme for the International Assessment of Adult Competencies (PIAAC) assessment. Interviewers record information about the room of assessment and interruptions that occurred during each interview. These observations, along with information on interviewer assignment…

Formative feedback currently receives attention as an effective means of increasing student learning. However, how to frame feedback to achieve the best effect is an ongoing debate. In this study we analyse a written data-set of 174 segments of teacher feedback and student response, coded using 10 emergent feedback and 14 response categories. As…

In this study, we investigated how empirical indicators of test-taking engagement can be defined, empirically validated, and used to describe group differences in the context of the Programme of International Assessment of Adult Competences (PIAAC). The approach was to distinguish between disengaged and engaged response behavior by means of…

The measurement of "consumer awareness" in health promotion campaigns is discussed. Seven effectiveness evaluations are reviewed. Problem areas, including interpretation of differently phrased awareness questions and response bias, are discussed. Recommendations for overcoming common problems are made, and an open discussion based on…

Problems in measuring the attitudes of whites toward blacks have included: (1) Lack of contemporary content in existing measures; (2) Difficulty of determining scale validity; and, (3) The strong social reinforcement for being "tolerant" toward blacks making the assessment of "true" racial attitudes more difficult. The…