Undergraduate English majors should have opportunities to conduct meaningful, authentic research. This essay outlines a research methods course that introduces students to empirical research with qualitative and quantitative tools. Over the course of the term, students complete a whole-class project that models the process and then also complete…

The individuals living in the 21st century have become the consumers of digital innovations and have to adapt, adopt and adapt to the new norm of surviving and thriving in the digital society. Familiarity with the latest technologies is not the only requirement for survival. One also needs to have relevant digital competencies to complete tasks…

Reliable measurements are key to social science research. Multiple measures of reliability of the total score have been developed, including coefficient alpha, coefficient omega, the greatest lower bound reliability, and others. Among these, the coefficient alpha has been most widely used, and it is reported in nearly every study involving the…

Publication bias and other forms of outcome reporting bias are critical threats to the validity of findings from research syntheses. A variety of methods have been proposed for detecting selective outcome reporting in a collection of effect size estimates, including several methods based on assessment of asymmetry of funnel plots, such as the…

When equating two test forms, the equated scores will be biased if the test groups differ in ability. To adjust for the ability imbalance between nonequivalent groups, a set of common items is often used. When no common items are available, it has been suggested to use covariates correlated with the test scores instead. In this article, we reduce…

Differences in rater judgments that are systematically related to construct-irrelevant characteristics threaten the fairness of rater-mediated writing assessments. Accordingly, it is essential that researchers and practitioners examine the degree to which the psychometric quality of rater judgments is comparable across test-taker subgroups.…

Many empirical economists say that the teaching of econometrics is unbalanced, and students are not well-prepared for the serious problems they will encounter with real data. Here, the author considers the problem of noisy data, which is present in most econometric studies, but receives far too little attention. Most econometric studies are done…

Propensity score analysis is a statistical method that balances pre-existing differences across treatment conditions achieving a similar condition as randomization and thus, allowing the estimation of causal effects in non-randomized experimental designs. The four stages in propensity score analysis are (1) propensity score estimation, (2)…

Aggressive behaviour is a significant issue for individuals with autism spectrum disorder (ASD), yet our understanding is limited compared to aggression in typically developing populations. This study examined behavioural, adaptive and cognitive data provided by the Simons Simplex Collection (N = 2184) to identify behavioural subgroups in children…

Purpose: This article reviews the development of quantitative methods in educational research in China since 1978. Design/Approach/Methods: For this summary and literature review, we used data from the China National Knowledge Infrastructure (CNKI), relevant books, and research output from the Graduate School of Education, Peking University.…

Cost, cost-effectiveness, and benefit-cost analysis are methods used by economists to evaluate public policies. Essentially, these methods rely on impact evaluations, that is, research studies of efficacy and effectiveness. However, in most research in education, these cost and impact evaluations are performed separately. This separation creates…

The natural experiment proposed in this article extracts three stories from boxes of "100 paper clips". The activity requires students to apply three lessons from inferential statistics, starting with a hypothesis test and including confidence intervals as well as tolerance intervals.

Cronbach's alpha is the most frequently used measure to investigate the reliability of measurement instruments. Despite its frequent use, many warn for misinterpretations of alpha. These claims about regular misunderstandings, however, are not based on empirical data. To understand how common such beliefs are, we conducted a survey study to test…

Cohen's kappa coefficient is commonly used for assessing agreement between classifications of two raters on a nominal scale. Three variants of Cohen's kappa that can handle missing data are presented. Data are considered missing if one or both ratings of a unit are missing. We study how well the variants estimate the kappa value for complete data…

Benefiting from item preknowledge (e.g., McLeod, Lewis, & Thissen, 2003) is a major type of fraudulent behavior during educational assessments. This paper suggests a new statistic that can be used for detecting the examinees who may have benefitted from item preknowledge using their response times. The statistic quantifies the difference in…