Surveys are typical for student evaluation of teaching (SET). Survey research consistently confirms the negative impacts of careless responses on research validity, including low data quality and invalid research inferences. SET literature seldom addresses if careless responses are present and how to improve. To improve evaluation practices and…

This issue of "Assessment Update" presents a three part series on fixing assessments. In Part 1, David Eubanks advocates for a collaborative model of assessment as the field enters a fourth decade of low return on investment. In Part 2, Megan R. Good laments the opportunity cost of continuing the define-measure-improve assessment model…

The cry that today's higher education students are particularly individualist is a commonly-heard one. In England, the considerable personal cost of tuition is often blamed for creating a series of negative student traits, including consumerism (an idea that one has bought the right to a degree) and individualism (a sense of the individual as the…

This issue of "Assessment Update" presents a three part series on fixing assessments. Assessment means different things, but it almost always includes accreditation reporting. In Part 1: David Eubanks describes what went wrong with the accreditation standards on learning assessment and the compliance culture that they created. This…

Rater comments tend to be qualitatively analyzed to indicate raters' application of rating scales. This study applied natural language processing (NLP) techniques to quantify meaningful, behavioral information from a corpus of rater comments and triangulated that information with a many-facet Rasch measurement (MFRM) analysis of rater scores. The…

This issue of "Assessment Update" presents a three part series on fixing assessments. In Part 1: "Assessment Standards are Broken," David Eubanks highlights the challenges with the assessment standards articulated by institutional accreditors. In this article, Part 2: Megan R. Good, discusses the opportunity costs faced and…

In this paper, we present an approach for online course evaluation based on learners' behaviors during the learning process, where the course creator can monitor the quality status of their online courses based on learners' learning outcomes and then intervene to improve the success rate. For this purpose, a set of criteria has been developed.…

This study explores the effects of feedback type, feedback occasion, and year level on student self-assessments in higher education. In total, 126 university students participated in this randomized experiment under three experimental conditions (i.e., rubric feedback, instructor's written feedback, and rubric feedback plus instructor's written…

This study investigates the perceptions of teachers and students toward formative assessment (FA) in higher education settings. The researchers developed a four-construct perception scale, namely self-assessment, interactive formal assessment, in-class diagnostic assessment, and subjective assessment. Data were collected from 216 participants--91…

This article explores the nature of the construct underlying classroom-based English for academic purpose (EAP) oral presentation assessments, which are used, in part, to determine admission to programmes of study at UK universities. Through analysis of qualitative data (from questionnaires, interviews, rating discussions, and fieldnotes), the…

Contribution: A competency assessment framework that enables learning analytics for course monitoring and continuous improvement. Our work fills the gap in systematic methods for competency assessment in higher education. Background: Many institutions are shifting toward competency-based education (CBE), thus encouraging their educators to start…

Instructional explanations are an ubiquitous component of classroom instruction, but are relatively neglected in science education when compared to other facets of teaching and learning. The ubiquity of instructional explanations and their potential to stimulate learning in students suggests that they should garner more attention from science…

Assessment of attitudes towards statistics [ATS] is needed to support the success of statistics education in tertiary institutions, so measuring instruments with high accuracy is required. However, existing instruments to measure ATS have not considered the use of technology as an essential variable affecting success in statistics education. The…

This study aims to establish a framework for student evaluation of online teaching and learning (SEOTL) through an analysis of SEOTL instruments implemented by universities and colleges. From a list of 131 R1 and 135 R2 institutions, we searched, reviewed, and identified 27 instruments for student evaluation of online teaching. A five-dimensional…

This study examined the effect of benchmarking and peer-assessment activities on second language (L2) French learners' self-assessments of accentedness, comprehensibility, and fluency. The learners, who included 25 L2 French students enrolled in a 15-week university-level French course, recorded two oral presentations at the beginning and the end…