Technical documentation for educational tests focuses primarily on properties of individual scores at single points in time. Reliability, standard errors of measurement, item parameter estimates, fit statistics, and linking constants are standard technical features that external stakeholders use to evaluate items and individual scale scores.…

Teacher evaluation has been closely tied to professional development. In special education, professional development experiences are meant to promote special educator learning and implementation of high leverage practices. Yet, the connection between teacher evaluation outcomes and professional development decisions of special educators is largely…

Traditional Chinese medicine (TCM) is an important component of China's medical system. How to educate TCM practitioners in China, therefore, has become a crucial issue. To contribute to this issue, the current research identified the competency model of TCM practitioners in China and developed an evaluation for TCM students. We combined Bloom's…

Assessment of clinical competence is complex and inference based. Trustworthy and defensible assessment processes must have favourable evidence of validity, particularly where decisions are considered high stakes. We aimed to organize, collect and interpret validity evidence for a high stakes simulation based assessment strategy for certifying…

Assessing higher-level verbal repertoires of individuals with autism and related intellectual disabilities is crucial due to the language and cognitive deficits experienced by this population as well as is the need for valid assessment tools for data-driven and individualized treatment. In addition to, curricula or instructional protocols that…

Much of applied linguistics research has been concerned with classroom-based second language (L2) development as it offers an ideal setting for examining the institutional ecology of L2 learning and teaching. However, scholars have continued to call for greater attention to the operationalization of constructs, selection of valid assessments, and…

We explore the conditions under which short, comparative interrupted time-series (CITS) designs represent valid alternatives to randomized experiments in educational evaluations. To do so, we conduct three within-study comparisons, each of which uses a unique data set to test the validity of the CITS design by comparing its causal estimates to…

This study investigates the relationships among factor correlations, inter-item correlations, and the reliability estimates of subscores, providing a guideline with respect to psychometric properties of useful subscores. In addition, it compares subscore estimation methods with respect to reliability and distinctness. The subscore estimation…

Popular teamwork assessments have been strongly criticized on the grounds of poor psychometric properties and their disconnect with conceptual models of teamwork. These issues raise concerns with respect to our ability to evaluate efforts devoted to advancing teamwork in academia. We report the development of a teamwork assessment that builds on…

The validity of joint attention assessment in school-aged children with ASD is unclear (Lord, Jones, "Journal of Child Psychology and Psychiatry" 53(5):490-509, 2012). This study examined the feasibility and validity of a parent-report measure of joint attention related behaviors in verbal children and adolescents with ASD. Fifty-two…

The validity of joint attention assessment in school-aged children with ASD is unclear (Lord, Jones, "Journal of Child Psychology and Psychiatry" 53(5):490-509, 2012). This study examined the feasibility and validity of a parent-report measure of joint attention related behaviors in verbal children and adolescents with ASD. Fifty-two…

This report reviews the "Social Skills Improvement System Social-Emotional Learning Edition" (SSIS SEL; Gresham & Elliott, 2017), a multicomponent rating scale that includes a criterion and norm-referenced measure of social-emotional and academic functioning--based on a reformulation of the "Social Skills Improvement…

The Vanderbilt Assessment for Leadership in Education (VAL-ED) is a 360-degree learning-centered behaviors principal evaluation tool that includes ratings from the principal, supervisors, and teachers. The current study assesses the test-retest reliability of the VAL-ED for a sample of seven school districts as part of multiple validity and…

When subscores on a test are reported to the test taker, the appropriateness of reporting them depends on whether they provide useful information above what is provided by the total score. Subscores that fail to do so lack adequate psychometric quality and should not be reported. There are several methods for examining the quality of subscores,…

Purpose: We tested the reliability and validity of the Self-Efficacy Questionnaire for Children (SEQ-C) in a sample of children living in orphanages in South Korea. Methods: Our study sample consisted of 334 children aged 13-18 obtained using a convenience sampling method. We conducted a confirmatory factor analysis to identify the factor…