General chemistry courses are often the foundation for the study of other science disciplines and upper-level chemistry concepts. Students who take introductory chemistry courses are more often from health and science-related fields than chemistry. As such, the content taught and assessed in general chemistry courses is envisioned as building…

Research on the test structure of the Force Concept Inventory (FCI) has largely ignored gender, and research on FCI gender effects (often reported as "gender gaps") has seldom interrogated the structure of the test. These rarely crossed streams of research leave open the possibility that the FCI may not be structurally valid across…

Organic chemistry is often promoted as a course designed to cultivate skill in scientific "ways of thinking." Expert organic chemists perceive their field as one in which plausible answers to complex questions are arrived at through analytical thought processes. They draw analogy between problem solving in organic chemistry and diagnosis…

In recent years, large-scale international assessments have been increasingly used to evaluate and compare the quality of education across regions and countries. However, measurement variance between different versions of these assessments often posts threats to the validity of such cross-cultural comparisons. In this study, we investigated the…

One of the greatest assessment challenges is providing fair and valid tests for multilingual pupils. Since language proficiency impacts their results on content tests, accommodations are suggested to help in solving the validity issues. In this mixed methods study on multilingual assessment, pupils were divided according to three testing…

The Test Of Astronomy STandards (TOAST) is a comprehensive assessment instrument designed to measure students' general astronomy content knowledge. Built upon the research embedded within a generation of astronomy assessments designed to measure single concepts, the TOAST is appropriate to measure across an entire astronomy course. The TOAST's…

This study describes how criterion-referenced feedback was produced from English language, mathematics and natural sciences monitoring assessments. The assessments were designed for grades 8 to 11 to give an overall indication of curriculum-standards attained in a given subject over the course of a year (N = 1113). The Rasch Item Map method was…

This report will determine to what degree the AP Physics 1 and 2 and AP Calculus AB and BC frameworks are aligned with the Trends in International Mathematics and Science Study (TIMSS) Advanced Physics and Mathematics frameworks. This will enable an exploration of any differences in content coverage and levels of complexity, and will set the stage…

Background: In 2011 the Progress in International Reading Literacy Study (PIRLS) and the Trends in International Mathematics and Science Study (TIMSS) were conducted at fourth grade in a number of participating countries with a shared representative sample. In this article we investigate whether there are multidimensional proficiency patterns…

Federal law requires that all students, including students with disabilities, participate in state assessments used for accountability purposes. It also requires states to assess students in several content areas, including science. Most students with disabilities take the general science assessment with or without accommodations, but a few…

Validity evidence based on test content is of essential importance in educational testing. One source for such evidence is an alignment study, which helps evaluate the congruence between tested objectives and those specified in the curriculum. However, the results of an alignment study do not always sufficiently capture the degree to which a test…

Many of the instruments developed for research use by the chemistry education community are relatively new. Because psychometric evidence dictates the validity of interpretations made from test scores, gathering and reporting validity and reliability evidence is of utmost importance. Therefore, the purpose of this study was to investigate what…

The success of all students, including students with disabilities, on statewide assessments in mathematics and reading/English language arts has been examined closely. This is due, in part, to the role of these content areas in school accountability for the Elementary and Secondary Education Act (ESEA) known as "No Child Left Behind" (NCLB).…

Current science assessments typically present a series of isolated fact-based questions, poorly representing the complexity of how real-world science is constructed. The National Research Council asserts that this needs to change to reflect a more authentic model of science practice. We strongly concur and suggest that good science assessments…

Studied content domain, format, and level of inquiry as factors contributing to the large variation in student performance across open-ended measures. Results for more than 1,200 eighth graders do not support the hypothesis that tasks similar in content, format, and level of inquiry would correlate higher with each other than with measures…