This study aims to determine the reliability of scores obtained from self-, peer-, and teacher-assessments in terms of teaching materials prepared by teacher candidates. The study group of this research constitutes 56 teacher candidates. In the scope of research, teacher candidates were asked to develop teaching material related to their study.…

This report briefly reviews the design and scoring procedure for the "TOEIC"® Speaking test and summarizes existing evidence about the consistency of TOEIC Speaking test scores. It then describes several analyses conducted using generalizability theory to provide additional information about the consistency of scores across different…

This study intends to develop a standardized instrument for measuring classroom teaching and learning in secondary chemistry lessons. Based on previous studies and interviews with expert teachers, the progression of five quality levels was constructed hypothetically to represent the quality of chemistry lessons in Chinese secondary schools. The…

Subscores are often used to indicate test-takers' relative strengths and weaknesses and so help focus remediation. But a subscore is not worth reporting if it is too unreliable to believe or if it contains no information that is not already contained in the total score. It is possible, through the use of a simple linear equation provided in…

There is quite a bit of evidence showing that the experience of learning an L2 will help in learning an L3, but as far as we know, very little research has investigated the possible impact of L3 learning on the already existing and still developing L2 system within the learner. According to Complex Dynamic Systems Theory (CDST), language…

Test scoring procedures should align with the intended uses and interpretations of test results. In this paper, we examine three test scoring procedures for an operational assessment of early numeracy, the Early Grade Mathematics Assessment (EGMA). The EGMA is an assessment that tests young children's foundational mathematics knowledge and has…

The aim of this study was to validate the Teacher Stress Inventory (TSI) for use in a South African context. The process of scale validation also sheds significant light on this culturally diverse group of participants' levels of psychological wellbeing and physical health, and its association with the level of stress that teachers reported. Using…

Academic self-efficacy refers to a student's confidence in successfully performing academic tasks at a designated level. Empirical research in US students suggests academic self-efficacy is a positive predictor of university student academic performance and retention, two outcomes that need to be increased in Saudi students. Given the potential…

This study investigated to what extent the Peabody Picture Vocabulary Test (PPVT-4) is a reliable tool for measuring vocabulary knowledge of English as a second language (L2), and to what extent L1 characteristics affect test outcomes. The PPVT-4 was administered to Dutch pupils in six different age groups (4-15 years old) who were or were not…

The Every Student Succeeds Act requires states to identify schools with low-performing student subgroups for Targeted Support and Improvement or Additional Targeted Support and Improvement. Random differences between students' true abilities and their test scores, also called measurement error, reduce the statistical reliability of the performance…

This Snapshot highlights key findings from a study that used Bayesian stabilization to improve the reliability (long-term stability) of subgroup proficiency measures that the Pennsylvania Department of Education (PDE) uses to identify schools for Targeted Support and Improvement (TSI) or Additional Targeted Support and Improvement (ATSI). The…

The "Stabilizing Subgroup Proficiency Results to Improve the Identification of Low-Performing Schools" study used Bayesian stabilization to improve the reliability (long-term stability) of subgroup proficiency measures that the Pennsylvania Department of Education (PDE) uses to identify schools for Targeted Support and Improvement (TSI)…

The purpose of this study was to identify the factor structure of the Child Oral and Motor Proficiency Scale (ChOMPS) and to evaluate the psychometric properties, including internal consistency reliability, test-retest reliability, and construct validity as measured by convergent and known-groups validity. Principal component analysis with varimax…

Purpose: Intercultural communicative competence (ICC) is important in intercultural exchange, to address problems and conflicts which may arise due to miscommunication that results from interlocutors' diverse cultural and linguistic backgrounds. Interlocutors may have different perceptions and interpretations of communicative behaviour. However,…

The main aims of this study were to further validate the Children's Social Understanding Scale (CSUS), which is a parent-report measure developed by Tahiroglu and colleagues, and to fill in some gaps in the existing research. Our study included more than 700 Polish parents from a diverse educational background who had children with disabilities,…