Central to the landscape of education is the understanding that instruction is fundamentally purposeful, aiming to facilitate effective learning. Grounded in this premise, instructional design emerges as a complex and multifaceted profession. In the digital era, Instructional Designers (IDs) harness technological advancements to shape robust…

In the evolving landscape of gaming, a need for reliable methods to differentiate expertise levels among players has emerged. This study defines experts by their exceptional skills, domain-specific knowledge, and successful application of these attributes in complex situations. Unlike conventional methods that rely on self-reported experience for…

Quality academic advising has been known to have lasting impacts on student success and persistence in higher education. In 2017, NACADA: The Global Community for Academic Advising established a set of 20 competencies known to be the essential topics that advisors and student success professionals have an understanding of, knowledge of, or skills…

This sequential-explanatory mixed-methods study assessed the construct validity of the educative Teaching Performance Assessment's (edTPA) Elementary Education Literacy, Elementary Education Math, and Early Childhood assessment areas. The edTPA is a portfolio-based subject-specific teaching performance assessment developed by Stanford's Center for…

Self-efficacy is frequently explored as a construct within assessments in counselor education (Crutchfield & Borders, 1997; Cashwell & Dooley, 2001; Kozina et al., 2010). However, despite the importance of advocacy in our field, there is a lack of research that measures self-efficacy in relation to advocacy attitudes and behaviors (Smith…

Apart from providing a bird's eye view of a given domain of inquiry (Ioannidis et al., 2015), systematic reviews such as methodological syntheses offer a magnifying glass on prevalent existing problems in primary research and furnish empirically grounded solutions to rectify these issues (Page et al., 2021). As survey research in second language…

The present study seeks to develop a situated construct of learner engagement within an instructional experience. Despite compelling potential benefits to instructional practice, extant learner engagement research has been limited to either within-the learner constructs or adding a simplistic behavioral component to a model and largely discounting…

The study aims to examine the interplay of two critical constructs in evaluation: essential evaluator competency and evaluator practice. The research questions in this study, according to Smith (2008), are essentially, what he defined as "fundamental issues in evaluation." These issues fall into one or multiple of the four aspects…

Validity of a measurement refers to appropriate test score meanings, uses, and interpretations (Messick, 1989; Kane, 1992). There are different approaches to validity: an evidentiary aspect of validity is one requiring gathering statistical evidence to evaluate test score meaning. A common approach to validation is comparisons of test score equity…

Determining the number of dimensions underlying many variables in the data or many items in the test is a crucial process prior to performing exploratory factor analysis. Failure to do so leads to serious consequences concerning construct validity. Parallel analysis (PA) has been found to be useful to determine the number of dimensions (i.e.,…

Given recent calls for advancing valid instrumentation in the field of cyberaggression, the present study evaluated construct validity and measurement invariance for the Cyberbullying Experiences Survey (CES) in a high school and college student sample. A series of confirmatory factor analyses (CFA), reliability analyses, and a nomological net…

The purpose of this three-manuscript dissertation was to examine the construct and predictive validity of the Community of Inquiry (CoI) framework (i.e., teaching, cognitive and social presence) through a confirmatory factor analysis, meta-analysis, and qualitative synthesis. The first paper was a confirmatory factor analysis study that…

Existing methods used to validate self-report questionnaires in foreign language teaching effectiveness have relied on Classical Test Theory (CTT). However, the use of CTT approaches limits the reliability and validity of self-report instruments. The Rasch Model, which is based on the principles of objective measurement, addresses some of the…

This dissertation bridges the literatures on race, migration, and health to highlight the acculturation experiences and related health implications among Chinese immigrants, particularly sojourning Chinese international students in the US. Due to their temporary stay in the recipient society, Chinese students usually demonstrate a sojourning…

To meet the needs of complex and/or underserved patient populations, health care professionals must possess diverse backgrounds, qualities, and skill sets. Holistic review has been used to diversify student admissions through examination of non-cognitive attributes of health care applicants. The objective of this study was to develop a novel…