This paper introduces a method for the assessment of creativity that relies on creativity tasks, a subjective evaluation procedure, and a planned missing data design that offers a drastic reduction in the overall implementation costs (administration time and scoring procedure). This method was tested on a sample of 149 people, using three…

The scientific approach to the study of creative problem-solving has shifted from using classic insight problems (e.g., the "Nine-dots" problem), toward sets of problems that have more robust psychometric properties, such as the Remote Associate Test (RAT). Because it is homogeneous, compact, quickly solvable, and easy to score, the RAT…

Writing assessment is a key feature of most education systems, yet there are limitations with traditional methods of assessing writing involving rubrics. In contrast, comparative judgement appears to overcome the reliability issues that beset the assessment of performance assessment tasks. The approach presented here extends previous work on…

This study attempted to discern the factor structure of the achievement goal orientation and goal structure constructs across the domain-specific task of essay writing in an Iranian EFL context. A convenience sample of 116 public university learners participated in a single-session, in-class study of an essay writing sampling and an immediate…

Reliability is usually estimated for a total score, but it can also be estimated for item scores. Item-score reliability can be useful to assess the repeatability of an individual item score in a group. Three methods to estimate item-score reliability are discussed, known as method MS, method [lambda][subscript 6], and method CA. The item-score…

Precision is a key facet of test development, with score reliability determined primarily according to the types of error one wants to approximate and demonstrate. This article identifies and discusses several primary forms of reliability estimation: internal consistency (i.e., split-half, KR-20, a), test-retest, alternate forms, interscorer, and…

Finding valid and reliable ways to assess complex clinical skills within psychology is a challenge. Recently, there have been some examples of applying Objective Structured Clinical Examinations (OSCEs) in psychology for making such assessments. The aim of this study was to examine students' and examiners' perceptions of a digital OSCE in…

In spring 2020, in response to the COVID-19 (for coronavirus disease 2019) pandemic, many early care and education centers, including Head Start centers, closed their physical buildings and changed their operations to virtual. Because of health and safety restrictions, OPRE was unable to directly assess children's skills in spring 2020 for the…

This study describes the development and initial testing of the Multidimensional Cultural Humility Scale (MCHS), a counselor-report scale to measure a counselor's cultural humility, with a sample of 861 participants. Exploratory factor analysis, confirmatory factor analysis, and internal reliability coefficients revealed evidence for the…

This study aimed to adapt the Selfitis Behavior Scale (SBS) to measure university students' selfitis behavior in Turkey. Within the scope of the study, the SBS was translated from English to Turkish. Data were collected in the validity and reliability studies from four study groups, including 343 university students. According to the confirmatory…

This study addressed the cross-cultural validation of the Chinese Motivation for Reading Questionnaire (CMRQ) in a sample of 522 seventh to ninth graders from two public schools in eastern China. Confirmatory factor analyses, item-total correlation analyses, and reliability analyses were conducted to assess the psychometric quality of the CMRQ.…

Purpose: This article describes the development and initial validation of the Speech-Language Pathologist (SLP) Involvement in Multi-Tiered System of Supports (MTSS) Questionnaire. It was developed to measure the extent to which SLPs are involved in MTSS at their school site(s). Method: A total of 567 SLPs practicing in the United States responded…

Assessment of individuals on the autism spectrum often includes a measure of nonverbal IQ. One such measure is the Raven's Standard Progressive Matrices (RSPM). For large research studies with participants distributed nationally it is desirable for assessments to be available online. Because time is a premium, it is ideal that the measure produces…

Although much attention has been given to rater effects in rater-mediated assessment contexts, little research has examined the overall stability of leniency and severity effects over time. This study examined longitudinal scoring data collected during three consecutive administrations of a large-scale, multi-state summative assessment program.…

The answer-until-correct (AUC) method of multiple-choice (MC) testing involves test respondents making selections until the keyed answer is identified. Despite attendant benefits that include improved learning, broad student adoption, and facile administration of partial credit, the use of AUC methods for classroom testing has been extremely…