This article describes and theorizes a failed writing program assessment study to question the influence of "the rhetoric of agreement," or reliability, on writing assessment practice and its prevalence in validating institutional mandated assessments. Offering the phrase "dwelling in disagreement" as a queer perspective, the…

One of the substantive changes in the 2014 Standards for Educational and Psychological Testing was the elevation of fairness in testing as a foundational element of practice in addition to validity and reliability. Previous research indicates that testing practices often do not align with professional standards and guidelines. Therefore, to raise…

Researchers and policymakers in the US and beyond increasingly seek to identify teaching qualities that are associated with academic achievement gains for K-12 students through effectiveness studies. Yet teaching quality varies with academic content and social contexts, involves multiple participants, and requires a range of skills, knowledge, and…

Coding is a process of assigning meaning to a given piece of evidence. Evidence may be found in a variety of data types, including documents, research interviews, posts from social media, conversations from learning platforms, or any source of data that may provide insights for the questions under qualitative study. In this study, we focus on text…

Socioscientific issues, issues that center on the intersection between scientific and social problems in real-world contexts, are valuable tools to use in science instruction due to their association with gains in scientific literacy, argumentation skills, and content knowledge. However, due to their complex nature, crafting instruction using…

Building and sustaining an organizational culture and climate where productive and positive leader-follower relationships can thrive is perhaps the single most important responsibility of those who aspire to lead. The attributes of benevolence, honesty, openness, reliability, and competence form a framework that individuals use in determining a…

In this article I provide an overview of the methodological issues involved in measuring constructs relevant to character development and education. I begin with a nontechnical overview of the 3 fundamental psychometric properties of measurement: reliability, validity, and equivalence. Developing and evaluating measures to ensure evidence of all 3…

We describe the development of a new, freely available, online, programmatic-level assessment tool, Measuring Achievement and Progress in Science in Physiology, or Phys-MAPS (http://cperl.lassp.cornell.edu/bio-maps). Aligned with the conceptual frameworks of Core Principles of Physiology, and Vision and Change Core Concepts, Phys-MAPS can be used…

To support students with disabilities who do not respond to typically effective reading intervention, special education teachers are expected to implement evidence-based practices for intensifying intervention. Data-based individualization is an effective, evidence-based practice recommended in research to intensify intervention, but requires…

There are two main lines of research in estimating classification accuracy (CA) and classification consistency (CC) under Item Response Theory (IRT). The R package cacIRT provides computer implementations of both approaches in an accessible and unified framework. Even with available implementations, there remains decisions a researcher faces when…

This essay highlights and extends the distinct and critical work of Black Girlhood Studies. With a particular focus on how it differentially engages Black girls and Black girlhood, it takes readers on a journey of rumination through my exploration of coming to understand reliability as taught to me by Black girls and Black girl celebratory spaces.…

The CRAAP Test (Currency, Relevance, Authority, Accuracy, Purpose), is a popular tool among academic librarians for instructing students in resource evaluation. Its applicability to web-based information makes it particularly useful for students as they think about information they encounter both inside and outside of scholastic settings. However,…

Assessment has an important role in education and it has a critical role in the teaching process. Through appropriate assessment, teachers can classify and grade their students, give feedback and structure their teaching accordingly. Recently, educators and scientists have been becoming more interested in the requirements of assessment procedures…

The "Dance Entry Level Teacher Assessment" (DELTA) measures pedagogical content knowledge and subject-specific content knowledge in dance. Created and administered jointly by the National Dance Education Organization and the State Education Agency Directors of Arts Education, DELTA represents a first step toward reaching national…

U.S. Supreme Court justices and other federal judges are, effectively, appointed for life, with no built-in check on their cognitive functioning as they approach old age. There is about a century of research on aging and intelligence that shows the vulnerability of processing speed, fluid reasoning, visual-spatial processing, and working memory to…