Many researchers have separately developed instruments to measure environmental characteristics such as attitudes, values, and knowledge. However, there is no instrument used to measure all these aspects in one comprehensive instrument. This study is meant to develop and validate a green character instrument which reveals student behavior and…

Falls are a significant medical and economical concern worldwide. Younger individuals with visual impairment (VI) may be more susceptible to falling and fall-related injuries when compared to peers without a VI. Self-perceived balance confidence is a psychological construct that may predict and/or mediate fall- or other health-related outcomes in…

The present investigation explored the psychometric validity of the five-item Gratitude Questionnaire (GQ-5) using a construct validation approach. Concerning within-network construct validity, results of item response theory (IRT) analysis via graded response model (GRM) showed that this scale could not discriminate individuals who score high in…

Background: There is an agreement that the methodological quality of randomized trials should be assessed in systematic reviews, but there is a debate on how this should be done. We conducted a construct validation study of the Physiotherapy Evidence Database (PEDro) scale, which is widely used to assess the quality of trials in physical therapy…

Background and Context: Despite the increasing implementation of coding in early curricula, there are few valid and reliable assessments of coding abilities for young children. This impedes studying learning outcomes and the development and evaluation of curricula. Objective: Developing and validating a new instrument for assessing young…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

Threats to construct validity should be reduced to a minimum. If true, sources of bias, namely raters, items, tests as well as gender, age, race, language background, culture, and socio-economic status need to be spotted and removed. This study investigates raters' experience, language background, and the choice of essay prompt as potential…

Under the framework of item response theory (IRT) and generalizability (G-) theory, this study examined the effects of item difficulty on rating reliability and construct validity on both the constructed-response (CR) items and essay items on English examinations. The data collected for this study were students' scores and responses on the two…

The relationship between the characteristics of 33 mathematical problem-solving questions answered by 16-year-old students in England and the quality of problem-solving elicited was investigated in two studies. The first study used comparative judgement (CJ) to estimate the quality of the problem-solving elicited by each question, involving 33…

Purpose: The purpose of this paper is to add to an emerging literature on educational leadership and management in Vietnam by addressing several goals. First, the study sought to translate, adapt, and validate an existing measurement instrument, the Principal Instructional Management Rating Scale (PIMRS) Teacher Form, for use in Vietnam. Next, it…

Scientific reasoning abilities are already developing in elementary-school-aged children and enable them to understand the world around them. The goal of the current study was to develop a new instrument for 8- to 10-year-old children in Grades 3 and 4 to measure their understanding of the steps of the "scientific inquiry cycle" (SIC).…

This article presents a comparative judgment approach for holistically scored constructed response tasks. In this approach, the grader rank orders (rather than rate) the quality of a small set of responses. A prior automated evaluation of responses guides both set formation and scaling of rankings. Sets are formed to have similar prior scores and…

This research provided a comprehensive evaluation and validation of the listening section of a newly introduced computerised test, Pearson Test of English Academic (PTE Academic). PTE Academic contains 11 item types assessing academic listening skills either alone or in combination with other skills. First, task analysis helped identify skills…

The purpose of this article is to describe preliminary psychometric characteristics of a student self-report measure of self-determination, the "Self-Determination Inventory: Student Report" version (SDI-SR), designed for youth with and without disabilities. We administered the draft assessment to 311 youth and examined item functioning…

In multidimensional forced-choice (MFC) questionnaires, items measuring different attributes are presented in blocks, and participants have to rank order the items within each block (fully or partially). Such comparative formats can reduce the impact of numerous response biases often affecting single-stimulus items (aka rating or Likert scales).…