We evaluate the predictive validity of the Massachusetts Candidate Assessment of Performance (CAP), a practice-based assessment of teaching skills that is now a requirement for teacher preparation program completion in Massachusetts. We find that candidates' performance on the CAP significantly predicts their in-service summative performance…

We investigate the predictive validity of teacher licensure tests using data from the Massachusetts Tests for Educator Licensure (MTEL). MTEL scores predict teachers' in-service performance ratings and contributions to student test scores (i.e., value added). We then explore whether these relationships vary for teacher candidates of color.…

Prior work has documented a substantial penalty associated with taking the Partnership for Assessment of Readiness for College and Careers (PARCC) online relative to on paper (Backes & Cowan, 2019). However, this penalty does not necessarily make online tests less useful. For example, it could be the case that computer literacy skills are…

We use teacher candidate test scores on the Massachusetts Tests for Educator Licensure (MTEL), linked to student and teacher outcomes in the state, to investigate the predictive validity of these teacher licensure tests. We find that MTEL scores are positive and statistically significant predictors of teachers' in-service performance ratings and…

Achieving effective use of new IT at the workplace can be notoriously difficult. There has been significant focus on the role of the individual in new job-related technology use, but considerations of personality differences and their role in effective use have been limited. Results have been mixed regarding the influence of personality on new IT…

We evaluate the predictive validity of the Massachusetts Candidate Assessment of Performance (CAP), a practice-based assessment of teaching skills that is typically taken during a candidate's student teaching placement and is a requirement for teacher preparation program completion in Massachusetts. We find that candidates' performance on the CAP…

A great deal of research in educational data mining is geared towards predicting student performance. Bayesian Knowledge Tracing, Performance Factors Analysis, and the different variations of these have been introduced and have had some success at predicting student knowledge. It is worth noting, however, that very little has been done to…

Using administrative longitudinal data from five states, we study how value-added measures of teacher performance are affected by changes in state standards and assessments. We first document the stability of teachers' value-added rankings during transitions to new standard and assessment regimes and compare our findings to stability during stable…

There is a paucity of evidence supporting the use of curriculum-based mathematics measures (M-CBMs) at the middle school level, which makes data-based decisions challenging for school professionals. The purpose of this study was to examine the relationships among three existing M-CBM indices: (a) basic facts, (b) concepts/application, and (c)…

There is empirical evidence to suggest that oral language and vocabulary on entering kindergarten are the best predictors of later reading success. Identifying skills that are predictive of later achievement using psychometrically sound measurement methods is a necessary component of early intervention efforts. Currently, there are limited methods…

This study investigated the relationship between emotional responses and reading performance in middle-school students. Although a large number of prior studies have investigated the relationship between emotion and reading, those studies have concentrated primarily on relatively static and distal measures of emotion. In this research, we measured…

This quasi-experimental value-added study provided evidence for the predictive validity of the Massachusetts MTEL General Curriculum Mathematics Subtest by finding an association between the licensure test results of 130 teachers and the growth of their 2640 grade 4 and 5 students. The study took advantage of a natural experiment that arose due to…

We present work toward automatically assessing and estimating science inquiry skills as middle school students engage in inquiry within a physical science microworld. Towards accomplishing this goal, we generated machine-learned models that can detect when students test their articulated hypotheses, design controlled experiments, and engage in…

This study examined whether the spelling abilities of adults with low literacy skills could be predicted by their phonological, orthographic, and morphological awareness. Sixty Adult Basic Education (ABE) students completed several literacy tasks. It was predicted that scores on phonological and orthographic tasks would explain variance in…

Data-mined models often achieve good predictive power, but sometimes at the cost of interpretability. We investigate here if selecting features to increase a model's construct validity and interpretability also can improve the model's ability to predict the desired constructs. We do this by taking existing models and reducing the feature set to…