Research on automated affect detection in educational software using play log data has shown promising results. Yet most studies use classroom-based software designed for adolescents or adults. In this paper, we aim to detect affection in an online educational platform primarily aimed at home use by young children. This presents two challenges: we…

The present study investigated the usefulness of a pre-programmed, teleoperated, socially assistive peer robot in dynamic testing of complex problem solving utilising the Tower of Hanoi. The robot, in a 'Wizard of Oz' setting, provided instructions and prompts during dynamic testing to children when they had to solve 3 D Tower of Hanoi puzzles.…

Explanatory typologies have recently experienced a renaissance as a research strategy for constructing and assessing causal explanations. However, both the new methodological works on explanatory typologies and the way such typologies have been used in practice have been affected by two shortcomings. First, no elaborate procedures for assessing…

In some institutions of higher learning, one of the approaches to successful governance is through student assessment of teachers, dubbed Student Assessment of Faculty or Student Evaluation of Teaching and extensively used in the United States of America (USA). In schools and colleges, the usual largest bloc and primary stakeholders are the…

This report and the accompanying online repository (https://sfdora.org/dora-case-studies/) bring together and analyse case studies in responsible academic career assessment. The case studies are intended to serve as inspiration for institutions planning to become or already engaged in a complex review process, and to provide potential pathways of…

Evaluation professionals need to be nimble and innovative in their approaches in order to be relevant and provide useful evidence to decision-makers, stakeholders, and society in the crowded public policy landscape. In this article, we offer serious games as a method that can be employed by evaluators to address three persisting challenges in…

Assessment of complex tasks integrating several competencies calls for a programmatic design approach. As single instruments do not provide the information required to reach a robust judgment of integral performance, 73 guidelines for programmatic assessment design were developed. When simultaneously applying these interrelated guidelines, it is…

Intercultural competence is a crucial element of foreign language education, yet the multifaceted nature of this construct makes it inherently difficult to assess. Although several tools for evaluating intercultural competence currently exist, research on their use in secondary school settings is scarce. This study reports on the development and…

In this paper, the authors describe how a study of a large database of written university teacher feedback in the department of Industrial Design led to the development of a new conceptual framework for feedback and the design of a new feedback tool. This paper focuses on the translation of related work in the area of feedback mechanisms for…

This article presents the principles and findings of developing a new participatory assessment of development (PADev) evaluation approach that was codesigned with Dutch nongovernmental organizations (NGOs) and northern and southern research institutes over a period of 4 years in the context of rural development in Ghana and Burkina Faso. Although…

Measuring values in sociological research sometimes involves the use of ranking data. A disadvantage of a ranking assignment is that the order in which the items are presented might influence the choice preferences of respondents regardless of the content being measured. The standard procedure to rule out such effects is to randomize the order of…

Background: Outcomes of static tests provide an indication of what children have learned in the past, up to the moment of testing, and can therefore underestimate the cognitive abilities of atypically developing children, such as children with language difficulties. In contrast, dynamic tests aim to examine children's potential for learning. The…

Proponents of dynamic testing have advocated its use as a replacement or addition to conventional tests. This research aimed to investigate the effects of using versus not using a pretest on both the outcome on the posttest and the processes used in solving inductive reasoning tasks in dynamic testing using a graduated prompts training.…

Purpose: We reevaluated the psychometric properties of the Amsterdam Inventory for Auditory Disability and Handicap (AIADH; Kramer, Kapteyn, Festen, & Tobi, 1995) using item response theory. Item response theory describes item functioning along an ability continuum. Method: Cross-sectional data from 2,352 adults with and without hearing…

As a part of the International Baccalaureate (IB) Diploma Programme (DP) students participate in the Theory of Knowledge (TOK) course. This research used a mixed methods design to investigate the perspective of TOK teachers in IB schools worldwide. To address the research questions, quantitative survey data were analyzed from 1,534 participants,…