We conducted conceptual replications for an online-administered general outcome measure known as critical content monitoring in science. Totally, 547 Grades 4 to 6 students from a rural Louisiana school district participated. Research questions addressed criterion validity, diagnostic accuracy, growth, and social validity concerns. Criterion…

A new, Holland-based Interest Inventory is proposed, intended to facilitate the transition from secondary to tertiary education. Specific interest items were designed to grasp activities that are prevalent during tertiary studies, including an Academic-track-scale to assist in the choice between academic and vocational-oriented programs. Interest…

Students with and without learning disabilities often struggle to learn a foreign language (FL). Teachers could benefit from a measure designed to screen and identify students at risk for FL learning difficulties. In this study, we examined the reliability and validity of scores from four curriculum-based measures (CBM) as potential indicators of…

We used meta-analysis to examine the criterion validity of four scoring procedures used in curriculum-based measurement of written language. A total of 22 articles representing 21 studies (N = 21) met the inclusion criteria. Results indicated that two scoring procedures, correct word sequences and correct minus incorrect sequences, have acceptable…

The article "Designing criterion-referenced assessment" (Burton, 2006) appeared in the "Journal of Learning Design," Volume 1, Issue 2 in 2006. Nine years later, Associate Professor Burton reflects upon her original article. when the article was written, the author worked at the Queensland University of Technology (QUT). At…

Criterion referenced tests of second language speaking performance are administered in different institutions using different procedures. The present study reports raters' practices of second language speaking tests, in particular the correspondence between test-takers' grades when assessed individually and in groups. Data derived from…

The assessment of physical literacy is vital and challenging for researchers and practitioners. Passport for Life is a Canadian global practitioner-based, formative, criterion-referenced assessment of physical literacy that is recorded in an online program. Students complete eight assessments divided across four broad categories of physical…

Three studies were conducted to generate a valid and reliable instrument to measure student-to-student confirmation. Study One (N = 396) sought to establish a factor structure based on previous research. Study Two (N = 396) sought to confirm this factor structure and assess criterion-related validity. Study Three (N = 283) sought to assess…

The development of valid and reliable strategies to efficiently determine the knowledge landscape of introductory astronomy college students is an effort of great interest to the astronomy education community. This study examines individual item response rates from a widely used conceptual understanding survey, the Test Of Astronomy Standards…

The criterion-related validity of divergent thinking (DT) tests has been questioned because of relatively low correlations between DT test scores and creative performance. A possible inhibiting factor in previous correlations--heterogeneity of the sample--has been ignored. If groups with different DT profiles are involved in this line of research,…

Geoscience education researchers have considerable need for criterion-referenced, easy-to-administer, easy-to-score, conceptual surveys for undergraduates taking introductory science survey courses in order for faculty to monitor the learning impacts of innovative teaching. In response, this study establishes the reliability and validity of a…

The study presents a critical analysis of written expression curriculum-based measurement (WE-CBM) metrics derived from 3- and 10-min test lengths. Criterion validity and classification accuracy were examined for Total Words Written (TWW), Correct Writing Sequences (CWS), Percent Correct Writing Sequences (%CWS), and Correct Minus Incorrect…

This study aimed at constructing a criterion-reference test to measure the research and statistical competencies of graduate students at the Jordanian governmental universities, the test has to be in its first form of (50) multiple choice items, then the test was introduced to (5) arbitrators with competence in measurement and evaluation to…

Because listening has received little attention and the validation of ability scales describing multidimensional skills is always challenging, this study applied a multistage, criterion-referenced approach that used a framework of aligned audio passages and listening tasks to explore the validity of the ACTFL and related listening proficiency…

Curriculum-Based Measures in writing (CBM-W) assesses a variety of fluency-based components of writing. While support exists for the use of CBM measures in the area of writing, there is a need to conduct further validation studies to investigate the utility of these measures within elementary and secondary classrooms. Since only countable indices…