This article introduces new statistics for evaluating score consistency. Psychologists usually use correlations to measure the degree of linear relationship between 2 sets of scores, ignoring differences in means and standard deviations. In medicine, biology, chemistry, and physics, a more stringent criterion is often used: the extent to which…

University science teachers' technological pedagogical and content knowledge (TPACK) is crucial for effective teaching. Although there has been a plethora of studies investigating pre-service and in-service teachers' TPACK, few studies have examined university instructors' TPACK and university students' perceptions of instructors' TPACK. The main…

These proceedings contain the papers of the 18th International Conference on Cognition and Exploratory Learning in the Digital Age (CELDA 2021), held virtually, due to an exceptional situation caused by the COVID-19 pandemic, from October 13-15, 2021, and organized by the International Association for Development of the Information Society…

A study was conducted to identify local item dependence (LID) in the context-dependent item sets used in an examination prepared for use in an introductory university physics class and to assess the effects of LID on estimates of the reliability and standard error of measurement. Test scores were obtained for 487 students in the physics class. The…

The Force and Motion Conceptual Evaluation (FMCE) is a multiple-choice test that has been used to evaluate physics instruction. However, the validity and reliability estimates have not been determined in a way a social scientist would expect. Few psychometric data were used to estimate the validity and reliability of the FMCE instrument. This…

Suggests improving test validity by deciding in advance the relative importance of each competence, and asking a colleague to read over the items and comment on any discovered ambiguities. Suggests increasing test reliability with item analyses. Discusses criteria for choosing objective or essay tests. (MLH)

This paper discusses some means by which one might answer the question of "What makes problem solving hard?" In order to facilitate the investigations required to answer this question, a model of problem solving is needed. From some simulated solutions to a physics problem, several problem solving processes used by students are…

The reliability and validity of the Judging Criteria Instrument as a measure of creativity in physics is examined. The instrument was found to be both reliable and valid. (JKS)