Sample size can be chosen to achieve a specified width in a confidence interval. The probability of obtaining a narrow width given that the confidence interval includes the population parameter is defined as the power of the confidence interval, a concept unfamiliar to many practitioners. This article shows how to utilize the Statistical Analysis…

Multiple-choice-questions are common in medical examinations, but guessing biases assessment results. Confidence-based-testing (CBT) integrates indicated confidence levels. It has been suggested that correctness of and confidence in an answer together indicate knowledge levels thus determining the quality of a resulting decision. We used a CBT…

This study adopted a quasi-experimental design with follow-up interview to develop a computer-based two-tier assessment (CBA) regarding the science topic of electric circuits and to evaluate the diagnostic power of the assessment. Three assessment formats (i.e., paper-and-pencil, static computer-based, and dynamic computer-based tests) using…

The purpose of this study was to explore Pre-service Elementary Science Teachers' (PSTs) conceptual understanding of Particulate Nature of Matter (PNM) through a three-tier diagnostic test. Participants were 215 PSTs from Turkey. Data consisted of participants' responses to the Particulate Nature of Matter Test (PNMT). The PNMT consists of…

Contradictory results have been reported regarding the accuracy of various methods used to assess student learning in higher education. The current study examined student learning outcomes across a multi-section and mult-iinstructor psychology research course with both indirect and direct assessments in a sample of 67 undergraduate students. The…

This study explored students' ability to evaluate their learning from a multimedia inquiry unit about the causes of global climate change. Participants were 90 sixth grade students from four science classrooms. Students were provided with a text describing the causes of climate change as well as graphs showing average global temperature changes.…

The scale of features shown on outcrop photographs can be critical to geoscience interpretations, yet little is known about how well individuals estimate scale in images. This study utilizes a visualization test in which participants were asked to estimate the absolute size of several boxes shown in outcrop images using high resolution, stitched…

This study aims to investigate about the existence of a graphical facilitation effect on probabilistic reasoning. Measures of undergraduates' performances on problems presented in both verbal-numerical and graphical-pictorial formats have been related to visuo-spatial and numerical prerequisites, to statistical anxiety, to attitudes towards…

This paper reports a quantitative study on gender differences in attitudes when learning oral skills via technology. The study was conducted at Tafila Technical University, Jordan, with 70 female and 30 male students, to find out if female students are better and faster in learning a language than male. Specifically, it seeks to investigate…

In theoretical models of self-regulated learning, calibration is one important component in successful learning. Two issues of calibration are explored. First, Nelson (1987) suggested the "G" (gamma) coefficient is the most appropriate measure of calibration (judgment accuracy) and rejected signal detection theory's "d'"…

Rigorous comparison of the reliability coefficients of several tests or measurement procedures requires a sampling theory for the coefficients. This paper summarizes the important aspects of the sampling theory for Cronbach's (1951) coefficient alpha--a widely used internal consistency coefficient. This theory enables researchers to test a…

The present study was directed at determining the extent to which the Type I Error rate is affected by violations in the basic assumptions of the q statistic. Monte Carlo methods were employed, and a variety of departures from the assumptions were examined. (Author)

An investigation is conducted which presents extensive Monte Carlo results which indicate the conditions under which a procedure using the F distribution can be used to study the robustness of the confidence interval procedures for small samples. A review of the literature is presented. Procedure uses a binary data matrix. Results indicate that…

This paper presents the development of scoring functions for use in conjunction with standard multiple-choice items. In addition to the usual indication of the correct alternative, the examinee is to indicate his personal probability of the correctness of his response. Both linear and quadratic polynomial scoring functions are examined for…

One formulation of confidence scoring requires the examinee to indicate as a number his personal probability of the correctness of each alternative in a multiple-choice test. For this formulation a linear transformation of the logarithm of the correct response is maximized if the examinee accurately reports his personal probability. To equate…