This research aims to compare the ability and item parameter estimations of Item Response Theory according to Maximum likelihood and Bayesian approaches in different Monte Carlo simulation conditions. For this purpose, depending on the changes in the priori distribution type, sample size, test length, and logistics model, the ability and item…

Literature review shows that the development process of an achievement test is mainly investigated in dissertations. Moreover, preparing a form that will shed light on developing an achievement test is expected to guide those who will administer the test. In this line, the current study aims to create an "Achievement Test Development Process…

This study aimed at evaluating a PISA-like reading test developed by teachers participating in the teacher training for teaching PISA-like reading. To serve this purpose, an experimental test was administered to 107 students aged 15-16 using a set of text and questions constructed according to the criteria of the PISA Reading test Level 1. Item…

Multiple-choice testing is considered one of the most effective and enduring forms of educational assessment that remains in practice today. This study presents a comprehensive review of the literature on multiple-choice testing in education focused, specifically, on the development, analysis, and use of the incorrect options, which are also…

This article provides an extensive overview of the recent literature on student evaluation of teaching (SET) in higher education. The review is based on the SET meta-validation model, drawing upon research reports published in peer-reviewed journals since 2000. Through the lens of validity, we consider both the more traditional research themes in…

Determining evidence-based practices is a complicated enterprise that requires analyzing the methodological quality and magnitude of the available research supporting specific practices. This article reviews criteria and procedures for identifying what works in the fields of clinical psychology, school psychology, and general education; and it…

Comments are made on the review papers presented by six Dutch psychometricians: Ivo Molenaar, Wim van der Linden, Ed Roskam, Arnold Van den Wollenberg, Gideon Mellenbergh, and Dato de Gruijter. Molenaar has embraced a pragmatic viewpoint on Bayesian methods, using both empirical and pure approaches to solve educational research problems. Molenaar…

A historical perspective on and substantive review of the concept of invariance are provided. Progress made toward solving measurement problems related to invariance is also assessed. Two major classes of invariant measurement are described: (1) sample-invariant item calibration; and (2) item-invariant measurement of individuals. The work of S. S.…

Group projects form a large and possibly growing component of the work undertaken for assessing students for postgraduate degrees in business. Yet the assessments sources, methods and purposes result in an array of combinations that the literature on assessment fails to capture in its full complexity. This paper builds on a new framework for…

Research on the potential effects of different item arrangement schemes on item statistics is reviewed for three separate periods. Earliest studies investigated the simple main effect of item order on test performance. The late 1960s emphasized interactions between item order and examinees' characteristics. Current concern focuses on item…

Item analysis is a very important consideration in the test development process. It is a statistical procedure to analyze test items that combines methods used to evaluate the important characteristics of test items, such as difficulty, discrimination, and distractibility of the items in a test. This paper reviews some of the classical methods for…

An empirical review of test items is described as an essential step in criterion-referenced test development. The concept of test items' instructional sensitivity is introduced, and research is briefly reviewed which describes four theoretical contexts in which instructional sensitivity indexes have been observed: criterion-referenced; classical…

J. E. Helms's (1995b) White racial identity theory is said to resemble a pseudoscience in certain respects because its empirical support is based on the White Racial Identity Attitude Scale (J. E. Helms & R. T. Carter, 1990) in spite of consistent evidence that the instrument does not measure the constructs that the theory proposes.

In this paper, we present a critical examination of the literature on subjective person-organization (P-O) fit and highlight several conceptual and measurement issues that may be perpetuating confusion in this literature. Specifically, we reviewed 46 empirical studies that have measured P-O fit perceptions and identified three primary sources of…

On the basis of the characteristics of criterion-referenced tests, the contribution of German research to the development and application of criterion-referenced tests is discussed. (PN)