Chalmers recently published a critique of the use of ordinal a[alpha] proposed in Zumbo et al. as a measure of test reliability in certain research settings. In this response, we take up the task of refuting Chalmers' critique. We identify three broad misconceptions that characterize Chalmers' criticisms: (1) confusing assumptions with…

The return on research investment resulting from new breakthrough scientific discoveries may be decreasing over time due to the law of diminishing returns, the relative decrease of research funding in terms of purchasing power parity, and various activities gaming the system. By altering the grant-review process, the scientific community may…

Maul's paper, "Rethinking Traditional Methods of Survey Validation" (Andrew Maul), contains two stages. First he presents empirical results that cast doubt on traditional methods for validating psychological measurement instruments. These results motivate the second stage, a critique of current conceptions of psychological measurement…

In this commentary on "Rethinking Traditional Methods of Survey Validation," found in this issue of "Measurement: Interdisciplinary Research and Perspectives," William Fisher writes that Maul's paper raises issues of validity in survey-based measurement that deserve far wider consideration and scrutiny than they typically…

This article is a commentary on McGill et al.'s (2020) article "Use of Translated and Adapted Versions of the WISC-V: Caveat Emptor." McGill et al. use caveat emptor in their title to indicate that the buyer of an assessment must be careful about the product being purchased, presumably because the seller of the assessment is not being…

Author Randall Langston feels that mentoring should never be viewed as a chore but rather a dynamic and transformational opportunity to impact a student's life. Often, the legacy that some people leave is the professional relationships they have forged with others. In fact, it's not unusual to hear keynote and other conference presentations in…

When the COVID-19 pandemic made it impossible to do in-person, on campus testing, we were forced to create a new system to screen International Teaching Assistants (ITA) for Temple university. We used this opportunity to address many of the concerns and problems that we had identified with the previous test, and created a new test that could be…

In this article, I respond to Noel Card's "Methodological Issues in Measuring the Development of Character." I focus on the ways in which social scientific knowledge represents human constructions of the world and the implications of this stance for the measurement of character. Further, I consider how context influences those…

The challenge of "educational" assessments--assessments that advance the purposes of learning and instruction--is to provide useful information regarding students' progress towards the goals of instruction in ways that are reliable and not idiosyncratic. In this commentary, the author indicates that the challenges are actually more…

In response to an argument by Baird, Andrich, Hopfenbeck and Stobart (2017), Michael Kane states that there needs to be a better fit between educational assessment and learning theory. In line with this goal, Kane will examine how psychometric constraints might be loosened by relaxing some psychometric "rules" in some assessment…

This rejoinder provides a reply to comments on a middle school college readiness index, which was devised to generate earlier and more nuanced readiness diagnoses to K-12 students. Issues of reliability and validity (including construct underrepresentation and construct-irrelevant variance) are discussed in detail. In addition, comments from…

The main points of Sijtsma and Green and Yang in Educational Measurement: Issues and Practice (34, 4) are that reliability, internal consistency, and unidimensionality are distinct and that Cronbach's alpha may be problematic. Neither of these assertions are at odds with Davenport, Davison, Liou, and Love in the same issue. However, many authors…

Ultimately, measures in research, testing, assessment and evaluation are used, or have implications, for ranking, intervention, feedback, decision-making or policy purposes. Explicit recognition of this fact brings the often-ignored and sometimes maligned concept of consequences to the fore. Given that measures have personal and social…

In our commentary on this excellent set of articles on "Sourcing in the Reading Process," we endeavor to synthesize the findings from the seven articles and discuss future research. We discuss significant contributions related to source memory, source evaluation, use of sources in action and belief, integration of information from…

In this article, Hartley notes the difficulties of using questionnaires to assess the efficiency of new instructional methods and highlights nine issues that researchers must consider. Hartley continues the discussion about the use of questionnaires and suggests that psychology teachers can help improve the teaching of psychology by drawing…