Our study investigates whether confidence correlates with consistency in reasoning, specifically about radioactive decay. In prior work, we developed and tested a survey designed to measure consistency of student reasoning about radioactive decay by comparing responses to three prompts that are isomorphic, meaning that, despite having different…

The assessment of human performance is not a new phenomenon. We have evidence that people have been required to prove their worth dating back at least to the Epic of Gilgamesh. What has changed, at least on a large scale, is the importance given to quantitative evidence in the evaluation process. For example, many employers have begun subjecting…

In this digital ITEMS module, Dr. Jacqueline Leighton and Dr. Blair Lehman review differences between think-aloud interviews to measure problem-solving processes and cognitive labs to measure comprehension processes. Learners are introduced to historical, theoretical, and procedural differences between these methods and how to use and analyze…

As an alternative to Cronbach's [alpha] for estimating scale reliability, McDonald's [omega] has attracted increased attention within the methodological community for its less stringent measurement assumptions. Notwithstanding, [omega] is still seldom used by practitioners, likely due to its unavailability in popular software packages (e.g., SPSS)…

The advent of artificial intelligence (AI), particularly large language models (LLMs) like ChatGPT and Gemini, has significantly impacted the educational landscape, offering unique opportunities for learning and assessment. In the realm of written assessment grading, traditionally viewed as a laborious and subjective process, this study sought to…

Questionnaire scales that are mixed-worded, i.e. include both positively and negatively worded items, often suffer from issues like low reliability and more complex latent structures than intended. Part of the problem might be that some responders fail to respond consistently to the mixed-worded items. We investigated the prevalence and impact of…

Background: Feedback as one of the most influential factors for learning has been subject to a great body of research. It plays a key role in the development of educational technology systems and is traditionally rooted in deterministic feedback defined by experts and their experience. However, with the rise of generative AI and especially large…

Past studies of grit's educational benefits, such as science engagement, showed mixed results across cultures. So, we elaborated the prior model of grit (perseverance of effort, consistency of interest) with "adaptability to situations" (forming a "triarchic model of grit" TMG), and tested TMG's relation to subsequent science…

Student absenteeism is a persistent concern in K-12 education. Not only are the negative academic and social consequences of excessive absenteeism well documented, but states, districts, and schools are increasingly being held accountable for student attendance. As research indicates that disruptions in students' learning contexts may exacerbate…

This study aims to identify the mean alpha coefficients of the Child PTSD Symptom Scale (CPSS-5) and examine the moderator role of trauma type and study location. We included studies using the CPSS-5 and reporting a Cronbach's alpha coefficient. Our analysis of 27 studies (k = 31) revealed a mean alpha coefficient of 0.91 for the CPSS-5. Mean…

Ferrari (2010) stated 20-25% of people self-identified as chronic procrastinators, which is a common self-regulatory failure involving stalling the initiation or completion of important duties or responsibilities until the last minute, after a predetermined deadline, or indefinitely (Dryden, 2000). This study is the first attempt to translate and…

Three preregistered studies examined whether 5-year-old children cheat consistently or remain honest across multiple math tests. We observed high consistency in both honesty and cheating. All children who cheated on the first test continued cheating on subsequent tests, with shorter cheating latencies over time. In contrast, 77% of initially…

Nearly all music educators assign grades to students. However, not all methods for grading are equally effective at reporting student achievement. This article describes one approach to grading, standards-based grading, that has the potential to support music educators' efforts to achieve grades that are honest, meaningful, and fair. General…

The remarkable strides in artificial intelligence (AI), exemplified by ChatGPT, have unveiled a wealth of opportunities and challenges in assessment. Applying cutting-edge large language models (LLMs) and generative AI to assessment holds great promise in boosting efficiency, mitigating bias, and facilitating customized evaluations. Conversely,…

Many autistic adults are likely to experience poor financial wellbeing and hardship due to unemployment and under-employment. Research in the general population demonstrates that subjective financial wellbeing--how people perceive their financial situation--influences quality of life. There is no research, however, examining the subjective…