Ensuring consistent and reliable scoring is paramount in education, especially in performance-based assessments. This study delves into the critical issue of marking consistency, focusing on speaking proficiency tests in English language learning, which often face greater reliability challenges. While existing literature has explored various…

Analysis of data from single-case intervention studies commonly involves visual analysis. Previous research indicates that visual analysis may suffer from low reliability and unpromising error rates. We investigated the reliability and validity of visual analysis and explored to what extent data trends affect judgments. We administered a…

The goal of this study is to determine the reliability of the performance points of dentistry students regarding communication skills and to examine the scoring reliability by generalizability theory in balanced random and fixed facet (mixed design) data, considering also the interactions of student, rater and duty. The study group of the research…

Reasoning for complexity is a fundamental competency in these complex times for solutions to social problems and decision-making. The purpose of this paper is to demonstrate the validity and reliability of the eComplexity instrument by presenting its psychometric properties. The instrument consists of a Likert-type scale questionnaire designed to…

The purpose of this study is to develop a valid and reliable Likert-type scale that can be used to measure the data literacy skills of educators. In the development process of the scale, after reviewing the relevant literature, a pool of 130 items was designed and presented to the experts for their view. After the evaluation of experts, the…

The purpose of this study is to examine the abstracts in 6th International Preschool Education Congress abstract book in terms of research subject, method, model, sample type, data collection tools, data analysis techniques, validity and reliability. This study is a qualitative study and was conducted using document analysis, which is one of the…

It is seen that the number of studies dealing with the values in children's literary products has been increased. Although there are many reviews on the studies concerning with value education, these reviews do not provide some significant details about these studies. This study has provided a content analysis of the studies on the values in…

Reading comprehension is often treated as a multidimensional construct. In many reading tests, items are distributed over reading process categories to represent the subskills expected to constitute comprehension. This study explores (a) the extent to which specified subskills of reading comprehension tests are conceptually conceivable to…

Data analysis is a significant methodological component when conducting quantitative education studies. Guidelines for conducting data analyses in quantitative education studies are common but often underemphasize four important methodological components impacting the validity of inferences: quality of constructed measures, proper handling of…

The present study aims to examine the graduate studies related to in-service training programs for teachers conducted between the years 2000 and 2018 in Turkey. In this context, the content analysis of 88 graduate studies, including 71 master thesis and 17 dissertations, was conducted for the in-service teacher training accessible to the Council…

The article outlines a methodology for systematically observing collective violence (and public order policing in relation to it). Specific attention is given to matters of sampling and measurement and to the way in which observational challenges have been met in comparison with participant observational studies of demonstrations and football…

Studies based on longitudinal data focus on the change and development of the situation being investigated and allow for examining cases regarding education, individual development, cultural change, and socioeconomic improvement in time. However, as these studies require taking repeated measures in different time periods, they may include various…

This study intends to develop a standardized instrument for measuring classroom teaching and learning in secondary chemistry lessons. Based on previous studies and interviews with expert teachers, the progression of five quality levels was constructed hypothetically to represent the quality of chemistry lessons in Chinese secondary schools. The…

In peer nomination research, individuals who do not provide nominations (nonparticipants) are often included on rosters as potential nominees. This can present ethical questions regarding informed consent, but psychometric consequences of excluding nonparticipants from rosters are unknown. In this investigation, Study 1 simulated both random and…

Listening to young children's voices is an issue with increasing relevance for many researchers in the field of early childhood research. At the same time, teachers and researchers are faced with challenges to provide children with possibilities to express their notions, and to find ways of comprehending children's voices. In our research we aim…