Higher Education faces challenges in providing learning experiences and cultivating competencies in our modern environment. Academic discourse centres on tutoring automation, a complicated educational dilemma in the age of Machine Learning, Deep Learning, and Artificial Intelligence. Establishing a structured technique for real competency…

Problem Statement: The most significant disadvantage of open-ended items that allow the valid measurement of upper level cognitive behaviours, such as synthesis and evaluation, is scoring. The difficulty associated with objectively scoring the answers to the items contributes to the reduction of the reliability of the scores. Moreover, other…

Dynamic measurement modeling (DMM) has been shown to improve the consequential validity of longitudinal mathematics assessment in the Early Childhood Longitudinal Study-Kindergarten (ECLS-K) database. Here, the authors demonstrate the capability of DMM to similarly improve the consequential validity of ECLS-K reading assessment through the…

This study explains assessment for learning instrumentation, especially in higher education. The population of this study was 100 lecturers of the Muhammadiyah Makassar University, Indonesia. A total of 50 items from six construct were analyzed and used to determine the reliability and validity of the questionnaire. The result shows that the…

There is a significant need for kindergarten entry assessments (KEA) that meet state education agency (SEA) requirements and are psychometrically sound measures of a broad range of school readiness domains such as language, literacy, math, science, executive function, and social-emotional skills. Research Findings: In this paper, we describe five…

The factorial survey is an experimental design consisting of varying situations (vignettes) that have to be judged by respondents. For more complex research questions, it quickly becomes impossible for an individual respondent to judge all vignettes. To overcome this problem, random designs are recommended most of the time, whereas quota designs…

Using the context of a 2-wk instructional unit focused on eye and vision health, we developed and validated a multilevel measure of middle school students' interest in science and health careers. This survey contained three subscales positioned differently with respect to curricular content. Interest in Vision Care was most related, but less…

Fundamental movement skills (FMS) competence is low in adolescent girls. An assessment tool for teachers is needed to monitor FMS in this demographic. The present study explored whether the Canadian Agility and Movement Skill Assessment (CAMSA) is feasible for use by physical education (PE) teachers of Australian Year 7 girls in a school setting.…

This article describes the development and administration of a survey to identify early childhood educators' successes and barriers when delivering remote instruction (e.g., online whole or small group instruction) during the COVID-19 pandemic to children 2-5 years old. The survey was developed using procedures outlined by the commonly accepted…

Background: Collecting data on instructional practices is an important step in planning and enacting meaningful initiatives to improve undergraduate science instruction. Self-report survey instruments are one of the most common tools used for collecting data on instructional practices. This paper is an instrument- and item-level analysis of…

Objective: This article reports on two separate studies of reliability of the Adolescent Domain Screening Inventory (ADSI), test-retest and internal consistency analyses. The ADSI has shown adequate validity, although reliability has not been established. Methods: Study 1: Students were recruited from two undergraduate courses (N = 29).…

International field placements are a unique educational opportunity for social work students to develop the skills they need for social work practice in a globalized world; however, outcomes of international placements have not been rigorously studied. This article reports on the International Volunteer Impacts Survey (IVIS), a 48-item survey…

Measures of survey reliability are commonly addressed in marketing courses. One statistic of reliability is "Cronbach's alpha." This paper presents an application of survey reliability as a reflexive application of multiple-choice exam validation. The application provides an interactive decision support system that incorporates survey item…

This manual provides guidance and documentation for users of the longitudinal kindergarten-fourth grade (K-4) public-use data file of the Early Childhood Longitudinal Study, Kindergarten Class of 2010-11 (ECLS-K:2011), which includes the first release of the public version of the third-grade data. This manual mainly provides information specific…

Automated writing evaluation (AWE) software uses artificial intelligence (AI) to score student essays and support revision. We studied how an AWE program called MY Access![R] was used in eight middle schools in Southern California over a three-year period. Although many teachers and students considered automated scoring unreliable, and teachers'…