The typical process for assessing inter-rater reliability is facilitated by training raters within a research team. Lacking is an understanding if inter-rater reliability scores "between" research teams demonstrate adequate reliability. This study examined inter-rater reliability between 16 researchers who assessed fundamental motor…

We evaluated structural, construct, and concurrent validity evidence for State-Interpersonal Reactivity Index scores among 208 telemental health counselors. Confirmatory factor analysis results supported a three-factor model. Partial correlation analyses yielded evidence for construct and concurrent validity evidence for scores. We discuss…

Internal validity and measurement invariance of the Counseling Center Assessment of Psychological Symptoms-62 item (CCAPS-62) was examined via confirmatory factor analytic models among autistic (n = 1,268) and non-autistic (n = 3,776) college students. Findings reviewed the CCAPS-62 had a strong model fit and was invariant across groups.

Research Findings: A growing number of stakeholders in early childhood education (ECE) rely on self-assessment to assess and improve the quality of ECE. In this systematic review, we investigated the reliability and validity of self-assessment in ECE, summarizing findings from 27 publications. We meta-analytically synthesized findings from 25…

In this article, we explore how people revise their belief in a hypothesis and the reliability of sources in circumstances where those sources are either independent or are partially dependent because of their shared, common background. Specifically, we examine people's revision of perceived source reliability by comparison with a formal model of…

Research self-efficacy is a key component of college students' career development. This study's purpose was to develop and begin to construct a validity argument for scores from the Sources of Research Self-Efficacy (SRSE) scale in college students. We explored validity evidence for SRSE scores from 719 undergraduate and graduate students based on…

This study aimed to expand the psychometric properties of the Theory Evaluation Scale (TES), specifically its structure, construct validity, and internal consistency. A demographically diverse sample of 113 social work faculty (N = 113) utilized the TES to appraise a social work theory and their responses were used for exploratory factor analysis…

Background: As delays or disorders in early language and communication are the most prevalent symptom in children with disabilities, early screening is crucial to promote prevention, early diagnosis, and intervention. However, to the best of our knowledge, no screening tool is available for the joint assessment of early language and social…

The Third Edition of the ACEI Global Guidelines Assessment (GGA) was evaluated for its effectiveness as an international assessment tool for use by early childhood educators to develop, assess, and improve program quality worldwide. This expanded study was conducted in nine countries [People's Republic of China (2 sites), Guatemala, India, Italy,…

Transactional validity, a common approach in participatory research, is attained when preliminary analyses of research results are discussed with research participants and their feedback is incorporated in the analysis. Member checking is one way of achieving transactional validity, which has been heralded as a stronger version of validity reached…

The author tested the psychometric properties of the Lifestyle Practices and Health Consciousness Inventory (LPHCI), an interdisciplinary healthcare screening tool, with a stratified random sample (N = 4,009) of Black and Latinx adults in all 50 states. Results of EFA, CFA, higher-order CFA, and multiple-group CFA all supported a 3-dimensional…

Attribute-framing bias (AFB) refers to addressees' bias in evaluating positively framed objects (80% success) more favorably than negatively framed ones (20% failure), although they are logically equivalent. The novelty of the current study is in examining conditions in which AFB occurs or does not occur. Typically, AFB is examined for favorable…

Academic self-concept (ASC) is characterized by the dual nature of stability and change. That is, students strive for consistency in their self-concept but also receive achievement feedback that leads to changes in ASC. Only a few previous studies have scrutinized the stability of ASC. The STARTS model (Stable, AutoRegressive Trait, and State)…

Existing measures of test anxiety used with the college student population are old with old norms and old items, and they do not capture the multiple dimensions of the test anxiety construct or assess facilitating anxiety. In the present study, the validity of the scores of a new, multidimensional measure of test anxiety with a facilitating…

This study investigates consistent and inconsistent respondents to mixed-worded questionnaire scales in large-scale assessments. Mixed-worded scales contain both positively and negatively worded items and are universally applied in different survey and content areas. Due to the changing wording, these scales require a more careful reading and…