In this study we evaluated the stability of item parameters and student scores, using the pre-equated (pre-pandemic) parameters from Spring 2019 and post-equated (post-pandemic) parameters from Spring 2021 in two calibration and equating designs related to item parameter treatment: re-estimating all anchor parameters (Design 1) and holding the…

Video is used widely in language education as a learning tool and a production tool for students to demonstrate oral competence. In response to the COVID-19 pandemic, Irish language lecturers at Dublin City University (DCU) set asynchronous video assessment tasks for students on teacher education programmes. Tasks were completed using the…

The proposed session sought to engage participants in a discussion about building assessment practices with students, as opposed to for students. Critical pedagogy may provide one way to redefine this previously uni-directional practice (Keesing-Styles, 2003). This approach concentrates student experience at the center of assessment, causing a…

This study examined the effects of intervention with a 2 × 2 factor manipulation, identifying the effects of evaluation indicators (presentation/construction) and evaluator (self/peer) on students' goal orientation. Specifically, we created five groups (one control group and four experimental groups) and conducted experimental lessons. The…

The assessment of program functionality can generally be accomplished with straight-forward unit tests. However, assessing the design quality of a program is a much more difficult and nuanced problem. Design quality is an important consideration since it affects the readability and maintainability of programs. Assessing design quality and giving…

Teachers' technological experiences are constrained by limitations in reflective decision-making and theoretical frameworks. Challenges with the technological pedagogical content knowledge framework (TPACK) are often associated with deficits in self-regulation. To effectively develop TPACK, it is recommended that educators focus on enhancing…

Evaluators have opportunities to advance equity within evaluations, yet little research has examined whether and how evaluators center equity in evaluation practice. This paper explores whether and how evaluators in New England address inequities and advance equity throughout evaluation phases. The study uses a complementarity, sequential mixed…

A successful flipped classroom relies heavily on student engagement in pre-class learning and their active participation in classroom activities. However, much to students' disappointment, their efforts in the learning process often go unnoticed in traditional assessment approaches (such as term papers and final examinations) that are more…

This article is a written version of the Presidential Address I gave at the annual meeting of the National Council on Measurement in Education (NCME) in April 2017. It is a call to NCME members (and others who read this, of course) to rebalance their focus so that classroom assessments are seen as being at least as important as large-scale…

An online peer-assessment system typically allows students to give textual feedback to their peers, with the goal of helping the peers improve their work. The amount of help that students receive is highly dependent on the quality of the reviews. Previous studies have investigated using machine learning to detect characteristics of reviews (e.g.,…

Recommender systems in educational contexts have proven effective to identify learning resources that fit the interests and needs of learners. Their usage has been of special interest in online self-learning scenarios to increase student retention and improve the learning experience. In current recommendation techniques, and in particular, in…

In this qualitative collective case study, we investigated how participating in external longitudinal root cause analyses (RCAs) contributed to the enhancement of instructional leadership practices of the leadership teams in three turnaround elementary schools in Texas. We participated with an external team of expert professors in conducting the…

This study investigated the effect of different assessment types on overall success in an online geoscience course covering energy's impact on the environment. Two groups took either the slower 1-credit or the faster 3-credit version of the course, which utilized the same content. Self-assessment questions developed using H5P, quizzes, summative…

In recent years, game-based learning has shown significant promise for creating engaging and effective learning experiences. Developing models that can predict whether students will struggle with mastering certain concepts could guide adaptive support to assist students with mastering those concepts. Game-based learning environments offer…

Mathematical calculations are an important part of chemistry. Those problems are difficult for students, especially if the task is set with a limiting reactant. The aim of this study was development of a Procedure for evaluation of cognitive complexity of the Stoichiometric Tasks with a Limiting Reactant. The procedure created included an…