Purpose: This study examines the psychometric properties of the Teamwork Scale for Youth, an assessment designed to measure youths' perceptions of their teamwork competency. Methods: The Teamwork Scale for Youth was administered to a sample of 460 youths. Confirmatory factor analyses examined the factor structure and measurement invariance of the…

Context: Athletic trainers are encouraged to work collaboratively with other health care professionals to improve patient outcomes. Interprofessional education (IPE) experiences for practicing clinicians should be developed to improve interprofessional collaborative practice postcertification. An outcome measure, such as the modified Readiness for…

The purpose of this research was to determine if the Pennsylvania Value-Added Assessment System Average Growth Index (PVAAS AGI) scores, derived from standardized tests and calculated for Pennsylvania schools, provide a valid and reliable assessment of teacher effectiveness, as these scores are currently used to derive 15% of the annual…

This study aimed at investigating the effect of two strategies of teaching reading: 'semantic mapping' and 'question generation' on the reading achievement of a sample of 40 female students enrolling in two classes in Level 2 English as a Second Language Foundation Program at the Community College of Qatar. The researcher of the current study…

This study assessed the reliability and criterion-related validity of teacher ratings on the Adapted Skillstreaming Checklist for a sample of 133 children, aged 6-11 years, with autism spectrum disorder (without intellectual disability). Internal consistency for the total sample was 0.93. For a subsample, test-retest reliability was very good (r =…

Background: Concept inventories (CIs) are commonly used in engineering disciplines to assess students' conceptual understanding and to evaluate instruction, but educators often use CIs without sufficient evidence that a structured approach has been applied to validate inferences about student thinking. Purpose: We propose an analytic framework for…

Critical thinking is widely considered an important skill for psychology majors. However, few measures exist of the types of critical thinking that are specific to psychology majors. Lawson (1999) designed the Psychological Critical Thinking Exam (PCTE) to measure students' ability to "think critically, or evaluate claims, in a way that…

Previous studies comparing holistic scoring to analytic scoring of second language writing have given mixed results. Some of them suffer from methodological drawbacks, such as limited writing sample size, limited number of raters, and lack of direct comparison of the two methods. Based on 300 writing samples graded by 14 raters, this research…

Grant peer review is a foundational component of scientific research. In the context of grant review meetings, the review process is a collaborative, socially mediated, locally constructed decision-making task. The current study examines how collaborative discussion affects reviewers' scores of grant proposals, how different review panels score…

The reliability of an assessment is defined as the extent to which candidates' results would remain stable if the entire assessment exercise was repeated. Whilst numerous studies have evaluated the reliability of written examinations, relatively little has been done to quantify the reliability of internal teacher assessment within schools. This is…

This study sought to develop a self-report instrument to be used in the assessment of the project competences of college students engaged in online project-based learning. Three scales of the KIPSSE instrument developed for this study, namely, the knowledge integration, project skills, and self-efficacy scales, were based on related theories and…

In this study, we examined the factor structure, reliability, and external validity of scores from the Comprehensive Test of Nonverbal Intelligence-Second Edition (CTONI-2) using an independent sample of young adults currently enrolled in a postsecondary institution. Although the subtests appear to be measuring general intelligence, the aggregate…

This article describes the development and validation of the new CATSS (Computer Adaptive Test of Size and Strength), which measures vocabulary knowledge in four modalities -- productive recall, receptive recall, productive recognition, and receptive recognition. In the first part of the paper we present the assumptions that underlie the test --…

With increasing competition for postgraduate research scholarships, awarding processes demand attention and scrutiny. We examine inter-rater reliability for two prestigious New Zealand scholarships, the Shirtcliffe Fellowship and the Gordon Watson Scholarship. For each scholarship, five assessors (three academic; two non-academic) independently…

We present considerations for validity when a population outside of a normed sample is assessed and those data are interpreted. Using a career group counseling example exploring life satisfaction changes as evidenced by the Quality of Life Inventory (Frisch, 1994), we showcase qualitative and quantitative approaches to explore how normative data…