This paper is based on a series of previous research studies looking at the impact and development of teachers in the UK and internationally. It suggests that there is no convincing evidence, in terms of test outcomes, that some teachers are more or less effective with equivalent pupils. This is not necessarily because teachers are not…

In the context of existing "quantitative"/"qualitative" schisms, this paper briefly reminds readers of the current practice of testing for statistical significance in social science research. This practice is based on a widespread confusion between two conditional probabilities. A worked example and other elements of logical argument demonstrate…

The classification by many scholars of numerical research processes as quantitative and other research techniques as qualitative has prompted the construction of a third category, that of "mixed methods", to describe studies that use elements from both processes. Such labels might be helpful in structuring our understanding of phenomena. But they…

The author previously published a paper discussing how to conduct an analysis based on a cluster sample. In that paper, the author outlined several widely adopted alternative approaches, and pointed out that such approaches are anyway not needed for population figures, and not possible for non-probability samples. Thus, the author queried the…

This paper considers the model of school effectiveness (SE) currently dominant in research, policy and practice in England (although the concerns it raises are international). It shows, principally through consideration of initial and propagated error, that SE results cannot be relied upon. By considering the residual difference between the…

When governments and pressure groups attend only to research that suits their political purposes, it makes a mockery of the idea of evidence-informed policy and practice. In this article, the author cites examples of research that picked up weak and misleading evidence for political purposes. The author argues that researchers are tied in to the…

There is a misconception among social scientists that statistical analysis is somehow a technical, essentially objective, process of decision-making, whereas other forms of data analysis are judgement-based, subjective and far from technical. This paper focuses on the former part of the misconception, showing, rather, that statistical analysis…

This paper uses the notion of "pathological" social science, wherein large claims to knowledge are made on the basis of very small differences in the data, to consider the notion of the school mix effect. It describes a variety of plausible alternative explanations for the same sets of findings, including the school mix effect, but also errors in…

This paper re-considers some of the evidence for low and declining social mobility in Britain, showing that one study based on a re-analysis of cohort figures appears to have had an impact on policy-makers out of all proportion to its scale and rigor. The study claimed to show that the income of parents and children were more closely related for…

This paper presents an argument against the wider adoption of complex forms of data analysis, using multi-level modeling (MLM) as an extended case study. MLM was devised to overcome some deficiencies in existing datasets, such as the bias caused by clustering. The paper suggests that MLM has an unclear theoretical and empirical basis, has not led…

This article started as a debate between the two authors. Both authors present a series of propositions about quality standards in education research. Cook's propositions, as might be expected, not only concern the importance of experimental trials for establishing the security of causal evidence, but also include some important practical and…

Uses the process of model building in applied settings to examine design experiment (DE) methodology, noting that DE work presented in this issue does not discuss model fitting or broader models of validation. Discusses key areas for the DE community to address, positing that the concept of artifact failure in design research may be a more…

This paper examines underachievement, a widely used term in education policy and practice often used to refer to nations, home nations, and regions; types and sectors of schooling; physiological, ethnic, and social groups; and individuals. It has been used to mean simply low achievement, also lower achievement relative to another of these groups,…

Secondary analysis of datasets can extend previous work in the field, provide a greater quantity of material, and has the advantages of speed and lower cost. More use of secondary data could improve the low esteem of educational research. (Contains 15 references.) (SK)

This paper considers the role of the British Educational Research Association (BERA) in promoting the improvement of UK research over the past 27 years. The views of some BERA representatives, as expressed at Conferences, in occasional publications and particularly in the pages of Research Intelligence, suggest a certain complacency. These…