In this digital ITEMS module, Dr. Michael Bunch provides an in-depth, step-by-step look at how standard setting is done. It does not focus on any specific procedure or methodology (e.g., modified Angoff, bookmark, and body of work) but on the practical tasks that must be completed for any standard setting activity. Dr. Bunch carries the…

Dynamic learning is a featured learning style in the second decade of the 21st century, emphasizing on the processes of individual or collaborative learning. Conducting dynamic assessment becomes critical to achieve the goals of learning. As learning becomes more individualized, online learning platforms have embedded a task recommender system to…

State testing programs regularly release previously administered test items to the public. We provide an open-source recipe for state, district, and school assessment coordinators to combine these items flexibly to produce scores linked to established state score scales. These would enable estimation of student score distributions and achievement…

The National Assessment of Educational Progress (NAEP) is the largest continuing and nationally representative assessment of what students in public and private schools know and can do in various subjects. First administered in 1969, NAEP collects and reports information on student trends and performance and compares the achievement of students in…

This report provides information about an interactive computer game named Say My Name that allows high school and undergraduate students to review individually nomenclature of organic compounds in an engaging and fun way by answering up to 600 questions distributed in three difficulty levels. Responses from students and teachers who have played…

In today's digital age, tests are increasingly being delivered on computers. Many of these computer-based tests (CBTs) have been adapted from paper-based tests (PBTs). However, this change in mode of test administration has the potential to introduce construct-irrelevant variance, affecting the validity of score interpretations. Because of this,…

Instruction plays a critical role in student success. However, most studies of teachers' effects on student learning focus on face-to-face settings. Some aspects of online courses, such as the choice of synchronous or asynchronous instruction and the course structure, might reduce teachers' influence on their students. For example, online courses…

The COVID pandemic forced many higher education institutions to pivot and switch to an online learning environment with minimal preparation. This transition was put in place during the middle of the spring semester, in March. During this transition, instructors had to quickly learn the tools of online teaching, navigate platforms like Webex and…

Our 1997 article in "IJAIED" reported on a study that showed that a new algebra curriculum with an embedded intelligent tutoring system (the Algebra Cognitive Tutor) dramatically enhanced high-school students' learning. The main motivation for the study was to demonstrate that intelligent tutors that have cognitive science research…

Difficulties in general education mathematics courses may be attributed to many factors, primarily low proficiency in symbol manipulation, a perception that mathematics is an area which eludes mastery, a lack of engagement and effective practice. Educational technology can be a powerful aid in overcoming these factors. This work describes the…

The purpose of this document is to provide information and advice to support states in meeting USED Peer Review Requirements related to demonstrating the comparability of test scores across various devices used for technology-based testing. The document is divided into four main sections. In the first section, we discuss and define the…

In Miyamoto et al. (2015, this issue) the authors looked to substantiate the presence of the spacing effect, referenced from the psychology literature, in several MOOCs. Their secondary analyses constituted a robust, empirical finding on the correspondence between session distribution and certification but with only a coarse, analogous…

Mooresville Graded School District (MGSD) in North Carolina, USA, was in a tough situation that is all too common for districts across the country. Its student poverty ratio rose significantly from 2007 to 2011 because of the economic recession, and it was ranked 99 out of 115 school districts for per-pupil expenditure in the state. No less than…

Dashboard systems are increasingly popular as assessment and performance management tools in higher education. This chapter examines the use of dashboards in student affairs, including examples of key indicators and considerations for developing and implementing these tools. The chapter begins with an overview of the origins of dashboards, from…

Traditionally, active engagement in higher education courses requires learners to spend time reading sections of an assigned textbook. Feedback from learners suggests that they are discouraged from reading when the text is difficult to access and isn't engaging. As an interactive digital environment, Revel aims to enhance students' engagement with…