Purpose: Most neural and physiological research on stuttering focuses on the fluent speech of speakers who stutter due to the difficulty associated with eliciting stuttering reliably in the laboratory. We previously introduced an approach to elicit stuttered speech in the laboratory in adults who stutter. The purpose of this study was to determine…

Data science, as a discipline can be used in any area. However, in order to utilize data science techniques, data scientist must be taught domain knowledge, referred to as a partner discipline, in the area with which the techniques are to be utilized. Using a quantitative analysis of publicly available information and survey methodology, this…

Traditional estimators of reliability such as coefficients alpha, theta, omega, and rho (maximal reliability) are prone to give radical underestimates of reliability for the tests common when testing educational achievement. These tests are often structured by widely deviating item difficulties. This is a typical pattern where the traditional…

Background: For peer assessment, reliability (i.e., consistency in ratings across peers) and validity (i.e., consistency of peer ratings with instructors or experts) are frequently examined in the research literature to address a central concern of instructors and students. Although the average levels are generally promising, both reliability and…

For predicting and improving the quality of essays, text analytic metrics (surface, syntactic, morphological, and semantic features) can be used to provide formative feedback to the students in higher education. In this study, the goal was to identify a sufficient number of features that exhibit a fair proxy of the scores given by the human raters…

This phenomenology research aims to examine prospective elementary mathematics teachers' proving and proof evaluation and their thoughts on convincing according to proof type and argument type. The participants were eight prospective teachers. The data collection tools were semi-structured group interviews, interviews video recordings and the…

Background: Objective Structured Clinical Examinations (OSCEs) are a simulation-based assessment tool used extensively in medical education for evaluating clinical competence. OSCEs are widely regarded as more valid, reliable, and valuable compared to traditional assessment measures, and are now emerging within professional psychology training…

To determine the effects of explicit instruction (EI) and potential moderators in second/foreign language (L2) teaching, this study meta-analyzed 28 primary reports (a total of 67 unique samples, N = 3754). The main results show that EI was significantly effective in facilitating L2 development, with effect sizes ranging from moderate to large…

Retrospective confidence refers to the phenomenological experience of the level of certainty that retrieved information is, in fact, correct. Retrospective confidence judgments are examined across a range of sub-disciplines in psychology from perception to memory research, and in education and legal applications. This paper focuses on…

The Mastery Performance-Goal Orientation Test (MP-GOT) assesses performance- and mastery-orientation along a single bipolar dimension. In Study 1 (n = 198) we explored its psychometric properties and determined whether its results were related to learning. In addition, we employed Latent Profile Analysis to explore goal orientation profiles. In…

Multidimensional measuring instruments are often used in behavioral, social, educational, marketing, and biomedical research. For these scales, the paper discusses how to find the optimal score based on their components that is associated with the highest possible reliability. Within the framework of structural equation modeling, an approach to…

Frailty is a health concern for many adults with intellectual disability and should be measured to detect at-risk conditions, monitor disease, plan treatment, and gauge mortality. This descriptive pilot study evaluated measurement consistency (inter-rater agreement) of the Intellectual Disability-Frailty Index Short Form among multiple assessors…

This study aims to generalize the reliability of the GAAIS, which is known to perform valid and reliable measurements, is frequently used in the literature, aims to measure one of today's popular topics, and is one of the first examples developed in the field. Within the meta-analytic reliability generalization study, moderator analyses were also…

Data extraction is a crucial, yet labor-intensive and error-prone part of evidence synthesis. To date, efforts to harness machine learning for enhancing efficiency of the data extraction process have fallen short of achieving sufficient accuracy and usability. With the release of large language models (LLMs), new possibilities have emerged to…

The purpose of this article is to discuss reliability and precision through the lens of a modern measurement approach, item response theory (IRT). Reliability evidence in the field of counseling is primarily generated using Classical Test Theory (CTT) approaches, although recent studies in the field of counseling have shown the benefits of using…