Even when raters demonstrate agreement in the use of a measure, limited score variability or violation of often-ignored statistical assumptions can result in lower reliability estimates than intuitively expected. This article uses data drawn from two randomized controlled trials of schema therapy and cognitive behavioral therapy for the treatment…

It is a necessity for a researcher to ensure that the validity and reliability of the study is met to prove a discovery. However, there are still qualitative researchers who are still reckless and do not emphasize the concept of validity and reliability when designing, collecting, and analysing the research findings. The quality of a qualitative…

Sample size and statistical power are important factors to consider when planning a research synthesis. Power analysis methods have been developed for fixed effect or random effects models, but until recently these methods were limited to simple data structures with a single, independent effect per study. Recent work has provided power…

Social scientists have long agreed that satisficing behavior increases error and reduces the validity of survey data. There have been numerous reviews on detecting satisficing behavior, but preventing this behavior has received less attention. The current narrative review provides empirically supported guidance on preventing satisficing by…

Purpose: Primary education (PE) forms the foundation of high-quality education systems, but it is often underestimated. This paper aims to develop and empirically validate a measurement instrument to study the current stage of total quality management (TQM) implementation in PE. Design/methodology/approach: This study developed a seven-dimensional…

With the advent of big data and advances in technology, psychological assessments have become increasingly sophisticated and complex. Nevertheless, traditional psychometric issues concerning the validity, reliability, and measurement bias of such assessments remain fundamental in determining whether score inferences of human attributes are…

Background and Aims: A literature review of both Eastern and Western literature regarding families of children with autism spectrum disorder (ASD) revealed limited empirical research that examines ASD in China. Furthermore, most research in this area comes from a deficit model and there is a lack of research that comes from a strengths background.…

Jeffrey Beall's blog listing of potential predatory journals and publishers, as well as his "Criteria for Determining Predatory Open-Access (OA) Publishers" are often looked at as tools to help researchers avoid publishing in predatory journals. While these "Criteria" have brought a greater awareness of OA predatory journals,…

About 45 R packages to analyze data using item response theory (IRT) have been developed over the last decade. This article introduces these 45 R packages with their descriptions and features. It also describes possible advanced IRT models using R packages, as well as dichotomous and polytomous IRT models, and R packages that contain applications…

This book provides an overview and discussion of the evidence base of effective school inspections; reflecting on issues of validity and reliability of school inspections in relation to school effectiveness research, unintended consequences and emergent roles and responsibilities of Inspectorates of Education. Chapters include findings from…

The goal of this paper is to examine the psychometric properties of a live-coded behavioral measure of joint attention, the "Attention-Following and Initiating Joint Attention Protocol" (JA Protocol), in order to assist researchers and clinicians in identifying when this measure may meet their joint attention assessment needs. Data from…

School climate measurement is a long-standing topic in educational research. This review article provides an overview and appraisal of school climate measures published between 2003 and 2013 in scientific journals. A search for published school climate instruments for secondary school students was made in three databases. Twelve articles meeting…

This brief provides tips for forming a team of staff and consultants with the needed expertise to make key measurement decisions that will ensure high-quality data for answering the study's research questions. The brief outlines the main responsibilities of measurement team members. It also describes typical measurement tasks and discusses…

This is the first book to gather and address what we have learned about the impacts and challenges of data-intensive teacher evaluation systems--a defining characteristic of the current education policy landscape. Expert researchers and practitioners speak to what we know (and what remains to be known) about evaluation measures themselves, the…

This book is relevant for language testers, listening researchers, and oral proficiency teachers, in that it explores four broad themes related to the assessment of L2 listening ability: the use of authentic, real-world spoken texts; the effects of different speech varieties of listening inputs; the use of audio-visual texts; and assessing…