When conducting a postal survey, a traditional recommendation is to use paper postage stamps instead of an automated postage system, to make sure that invitations have a more personal and attractive appearance. In this research note, we investigate whether this traditional recommendation is still valid. In the autumn of 2020, a postal survey was…

Correspondence studies are popular tools for assessing discrimination against minorities, for example, in the labor market. Typically, two fake "Curriculum Vitae" (CVs) are sent to multiple job openings. The CVs are equivalent except for a mark identifying the disadvantaged. While it is straightforward to establish discrimination from…

Transactional validity, a common approach in participatory research, is attained when preliminary analyses of research results are discussed with research participants and their feedback is incorporated in the analysis. Member checking is one way of achieving transactional validity, which has been heralded as a stronger version of validity reached…

Data analysis is a significant methodological component when conducting quantitative education studies. Guidelines for conducting data analyses in quantitative education studies are common but often underemphasize four important methodological components impacting the validity of inferences: quality of constructed measures, proper handling of…

This research study aims to evaluate the graduate theses and articles conducted on the concept of instructional leadership over the period between 2002 and 2017 in Turkey by means of methodological and statistical analysis techniques. In the study, which is configured by using the case study design as one of the qualitative research methods, the…

Based on findings from a large meta-data-based literature survey, this article is intended to provide a comprehensive synthesis of key features of China's music education system as seen through the lens of n = 116 major research studies, drawn from a total of N = 3,257 high-impact Chinese journal articles published during 2007 to 2019. The…

The use of controlled comparisons pervades comparative historical analysis. Heated debates have surrounded the methodological purchase of such comparisons. However, the quality and validity of the conceptual building blocks on which the comparisons are based have largely been ignored. This article discusses a particular problem pertaining to these…

Considering scoring validity as encompassing both reliable rating scale use and valid descriptor interpretation, this study reports on the validation of a CEFR-based scale that was co-constructed and used by novice raters. The research questions this paper wishes to answer are (a) whether it is possible to construct a CEFR-based rating scale with…

This paper reviews literature on the rationale, challenges, and recommendations for choosing a nonequivalent comparison (NEC) group design when evaluating intervention effects. After reviewing frequently addressed threats to validity, the paper describes recommendations for strengthening the research design and how the recommendations were…

Action research provides valuable opportunities for preservice teachers to improve their practice, their understanding of their practice, and the situation in which their practice takes place. Moreover, action research empowers preservice teachers to critically examine an experience that demonstrates their potential to be influential researchers…

Compared alprazolam, imipramine, and placebo in the treatment of panic disorder patients (n=59) to investigate concerns about the internal validity of the double-blind design. Found that the great majority of patients and physicians were able to rate accurately whether active drug or placebo had been given and physicians could distinguish between…

Notes that problems of measurement in educational research are often addressed by using the terms validity and reliability. Discusses the meaning given to these terms and how they relate to the aims of the measurement process in educational research. (RKM)

Qualitative research evokes rather stereotyped responses from the mainstream of social science. The following 10 standardized responses to the stimulus "qualitative research interview" (QRI) are discussed: (1) it is not scientific, only common sense; (2) it is not objective, but subjective; (3) it is not trustworthy, but biased; (4) it is not…

An introduction to profiles is presented with examples provided to permit an overall appraisal of the potential of profiles, of the principles upon which they might be based, and of the problems that will have to be overcome if their potential is to be realized in practice. The larger scale examples of profiles discussed are the Scottish Pupil…

A plea is made for increased field studies in education. Some of the problems are outlined: time and working hours, conflicting research paradigms, interpersonal relations in institutional settings, and financial and moral support. Examples are drawn from studies in South Australia. Solutions to the problem of reciprocal…