Recent investigations challenge the construct validity of sustained silent reading tests. Performance of two groups of post-secondary students (e.g. struggling and non-struggling) on a sustained silent reading test and two types of cloze test (i.e. maze and open-ended) was compared in order to identify the test format that contributes greater…

In this paper I conceptualize experiences with technology as an object of study for educational technology research and propose phenomenology as a highly suitable method for studying this construct. I begin by reviewing existing research focusing on the construct of experiences with technology and the approaches utilized for its study. To augment…

The National Survey of Student Engagement (NSSE) Benchmarks has emerged as a competing paradigm for assessing institutional effectiveness vis-a-vis the U.S. News & World Report. However, Porter (2009) has critiqued it for failing to meet validity and reliability standards. This study investigated whether the NSSE five benchmarks had construct…

This study examined test takers' perception of assessment demand and its impact on the measurement of intended constructs. More than 800 test takers took a pre- and a posttest of College English Test Band 4 and filled in a perception questionnaire to report the skills they perceive as necessary for answering the test. The study found test takers…

Objective: This paper presents the reliability and validity of a "competing food choice" construct designed to assess whether factors related to consumption of less-healthful food were perceived to be barriers to fruit and vegetable consumption in college freshmen. Design: Cross-sectional, self-administered survey. Setting: An urban public college…

The purpose of this study was to explore college students' recognition of temporal magnitudes associated with durations of scientific changes through construct validation of a 30-item instrument. We administered the instrument to 514 students from 10 higher education institutions in the United States. Among them, 419 students took the instrument…

The purpose of this article is to provide an overview of the process used to examine the inter-rater reliability of the Teacher Work Sample (TWS) Scoring Rubric involved with the senior culminating experience for teacher candidates used at a large comprehensive university. The study compared holistic and analytic scores reported by Student Teacher…

This paper developed a Democratic Classroom Survey to measure students' perceived democratic environment of the classroom. Perceived democratic environment is one of the most important variables for understanding classroom activity and indeed any type of group activity, but actually measuring perceptions in an objective manner has been…

Immigration into the U.S. will continue to increase in the coming years, thereby increasing the postsecondary enrollment of ESL students. Yet there is still a limited amount of research designed to evaluate which ESL placement programs are most effective. This study was designed to determine if the use of correct testing instruments would ensure…

This article focuses on the development and validation of the Ethical Leadership Index (ELI). The development and validation processes included: adopting a framework; developing items; providing evidence of content validity; conducting a pilot study; and analyzing data to provide evidence of construct validity and reliability estimates. Five…

As institutions seek to promote student engagement on campus, the National Survey of Student Engagement (NSSE) is increasingly being used to chart progress and compare results using the Five Benchmark Scores. While recent research has begun to decompose the five benchmarks in a variety of ways; few research studies have sought to explore the…

The following describes research supported by the Teagle Foundation for the development and testing of an instrument for measuring college student perceptions of institutional mission in the learning environment. Findings from reliability and validity testing of a set of questions called the Mission Perception Inventory (MPI) are discussed. The…

The concept of "student effort" is foundational to such commonly used assessments of institutional effectiveness as the National Survey of Student Engagement (NSSE) and the Community College Survey of Student Engagement (CCSSE). However, the current measure of student effort omits intercultural effort, which is particularly salient to the academic…

Typical validation studies on standard setting models, most notably the Angoff and modified Angoff models, have ignored construct development, a critical aspect associated with all conceptualizations of measurement processes. Stone compared the Angoff and objective standard setting (OSS) models and found that Angoff failed to define a legitimate…

The main aim of this study is the comparative examination of the factor structures, corrected item-total correlations, and Cronbach-alpha internal consistency coefficients obtained by different methods used in imputation for missing values in conditions of not having missing values, and having missing values of different rates in terms of testing…