This paper reports on literature related to the assessment of barriers to educational technology assessment. It surveys the development of technology acceptance models from social cognitive theory and innovation diffusion theory through to a unified theory that considers performance expectancy, effort expectancy, and social influence. Because risk…

Questionnaire refinement and a process for selecting items for elimination are important tools for survey developers. One of the major obstacles in questionnaire refinement and elimination in surveys lies in one's ability to adequately and appropriately reconstruct a survey. Often times, surveys can be long and strenuous on the respondent,…

Cultural differences between faculty and their students can create important challenges that affect the quality and efficacy of online teaching and learning. The objectives of this study were to: (a) create and pilot test an assessment for online faculty to measure culturally responsive teaching knowledge (CRT) and culturally responsive…

In this study, the "Information Seeking Strategies" scale that was developed by Mills, Knezek and Wakefield (2013) has been adapted to Turkish language. A confirmatory factor analysis was run and subsequently, two items were removed. The fact that these two items are related to learning in a traditional class environment may be…

Classical guitar ensembles are increasing in the United States as popular alternatives to band, choir, and orchestra. Classical guitar ensembles are offered at many middle and high schools as fine arts electives as one of the only options for classical guitarists to participate in ensembles. The purpose of this study was to explore the development…

This paper intends to construct a survey data quality strategy for institutional researchers in higher education in light of total survey error theory. It starts with describing the characteristics of institutional research and identifying the gaps in literature regarding survey data quality issues in institutional research. Then it is followed by…

The tendency for some survey respondents to be unreasonably agreeable on attitude measures with an agree-disagree format is typically termed acquiescence, or acquiescent responding (AR). This paper suggests an alternative operational definition of AR plus a statistical test for identifying AR subjects. If positively and negatively phrased items…

The controversy regarding reverse or negatively-worded survey stems has been around for several decades. The practice has been used to guard against acquiescent or response set behaviors. A 20-item, 5-point Likert item survey was designed and the stems and response sets were varied in a 2 by 3 design. One independent variable was type of item…

Using data collected through telephone interviews with a national sample of adults, this study searched for evidence as to whether interviewers have stronger effects on the responses given to a wide range of questions by older people than on the responses of younger people. Responses to 30 items for which significant interviewer effects had…

This paper discusses the results of a study comparing the psychometric qualities of two forms of a survey, one administered in paper-and-pencil format and the other administered in Web format. The survey addressed the topic of college course anxiety and was used to survey a sample of undergraduate students (n=36). The psychometric qualities…

An analysis of variance approach to estimating reliability is examined. This approach uses an internal-consistency index for estimating the reliability of survey instruments containing ranked items, and is recommended when the relative ranking of item means is of interest to survey researchers. The computation of this index is demonstrated using…

Research libraries are increasingly supplementing collection counts with perceptions of service quality as indices of status and productivity. The present study was undertaken to explore the reliability and validity of scores from the SERVQUAL measurement protocol (A. Parasuraman and others, 1991), which has previously been used in this type of…

As part of its school improvement effort, AEL, a regional education laboratory, developed the Continuous School Improvement Questionnaire (AEL CSIQ). Staff from the AEL Quest schools program drafted a 65-item questionnaire to help measure and assess the efforts of the project team in their work with the 18 schools in the Quest network. These items…

Job analysis has played a fundamental role in developing and validating licensure and certification examinations, but research on what constitutes reliable and valid job analysis data is lacking. This paper examines the reliability and validity of job analysis survey results. Generalizability theory and the multi-facet Rasch item response theory…

A description is presented of the development of an attitude survey, the Mississippi Student Teacher Attitude Inventory, which was designed to establish a reliable instrument for obtaining feedback concerning student teaching. A synthesis of studies from related literature indicate that there are numerous ways to approach the assessment of student…