This article provides a conceptual framework for considering both the theoretical and methodological factors that underpin the successful validation of a competency framework. Drawing on educational assessment literature, this article argues that a valid competency framework relates to an interpretive judgement of the credibility of the claims…

Large swaths of data are readily available in various fields, and education is no exception. In tandem, the impetus to derive meaningful insights from data gains urgency. Recent advances in deep learning, particularly in the area of voice and image recognition and so-called complete knowledge games like chess, go, and StarCraft, have resulted in a…

The purpose of the present study was to assess the impact of coaching with performance feedback from teachers on accuracy of paraeducators' momentary time sampling (MTS) data of students' on-task behavior. Two lead teachers and three paraeducators participated in the study. The relation between coaching and accuracy of the data collection was…

A large dataset of word recognition behavior from nonnative speakers (NNS) of English was collected using an online crowdsourced lexical decision task. Lexical features were used to predict NNS lexical decision latencies and accuracies. Predictors of NNS latencies and accuracy included contextual diversity, age of acquisition, and contextual…

The need for data-informed decisions is not limited to national policy, state systems, or senior leadership of postsecondary institutions. Decisions that impact the achievement of higher education missions are also made by students, faculty, frontline staff, and program administrators--all of who deserve data and information to support their…

We analyze results from paired pre- and post-instruction administration of the Mechanics Baseline Test to 2238 students in introductory mechanics classes. We investigate pairs of specific wrong answers given with unusual frequency by students on the pretest. We also identify transitions between pre- and post-test answers on the same question which…

This article explores ways to improve the use and usefulness of four large and independently developed U.S. Education Department (ED) school-based data collections: the annual EDFacts' student outcomes on state assessments and high school graduation rates; the annual Common Core of Data's student and teacher counts and district and state finances;…

This commentary to the recent article by Musso et al. (2013) discusses issues related to model fitting, comparison of classification accuracy of generative and discriminative models, and two (or more) cultures of data modeling. We start by questioning the extremely high classification accuracy with an empirical data from a complex domain. There is…

Scores on annual statewide achievement tests can provide parents, students, educators, and policymakers with valuable information--but only if students participate. This issue brief provides the background about recent increases in (and efforts to expand) the number of students opting out of statewide assessments, describes the information and…

This article examines two methodological issues regarding ways of obtaining and analyzing outcome data for people with intellectual disabilities: (a) self-report and proxy-report data and (b) analysis of population-based data sets. Some people with intellectual disabilities have difficulties with self-reporting due to problems of understanding and…