Family income questions in general purpose surveys are usually collected with either a single-question summary design or a multiple-question disaggregation design. It is unclear how estimates from the two approaches agree with each other. The current paper takes advantage of a large-scale survey that has collected family income with both methods.…

Using secondary data has many advantages, but there are also many limitations, including the lack of relevant information. This article draws on a previous study that used secondary data to investigate substance use in young, elite athletes. Three types of missing data appeared: missing data, lack of information about the data collection process,…

The present study used quantitative and qualitative measures to examine Iranian applied linguists' (mis-) conceptions of ethical issues in research. For this purpose, one hundred and twelve applied linguists completed a research ethics questionnaire constructed and validated by the researchers. In the follow-up qualitative phase, 15 applied…

In web surveys, no interviewer is present to clarify question comprehension problems, which can be particularly prevalent among respondents with low literacy skills. Although plain language is used in various contexts to improve text comprehensibility, its use in social science questionnaires has not been investigated to date. Using a…

Many countries rely on statements issued by professional associations to delimit the scope of school psychological practice. It is, however, not always clear to what extent these statements match current practices and school psychologists' self-perception of their professional role, as empirical data is often unavailable or limited. This study…

Introductory undergraduate statistics courses widely focus on statistical concepts or software-based data analysis. Despite the fact that the analysis of real data has shown to enhance students' engagement, the step of data collection is often neglected. Once students know the challenges of data collection, they are more aware of potential…

Probes are follow-ups to survey questions used to gain insights on respondents' understanding of and responses to these questions. They are usually administered as open-ended questions, primarily in the context of questionnaire pretesting. Due to the decreased cost of data collection for open-ended questions in web surveys, researchers have argued…

Background: Online crowdsourcing platforms, such as Amazon Mechanical Turk (MTurk), have become popular alternatives to the ubiquitous student samples used in psychology research. r/SampleSize, an alternative pool on the website Reddit, allows for online participant recruitment without compulsory or immediate payment, making it potentially useful…

The designs of many student-facing learning analytics (SFLA) dashboards are insufficiently informed by educational research and lack rigorous evaluation in authentic learning contexts, including during remote laboratory practical work. In this article, we present and evaluate an SFLA dashboard designed using the principles of formative assessment…

Online surveys are widely used in social science research as well as in empirical studies of open, online, and distance education. However, students' responses are likely to be at odds with their actual behavior. In this context, we examined the discrepancies between self-reported use and actual use (i.e., learning analytics data) among 20,646…

Purpose: This article presents focus groups as a method to enhance questionnaire design to frame and test items for a mass survey on corruption and austerity in democracy. Such methodology lacks systematization when it comes to the description of implementation procedures and the discussion of effective contribution to the development of survey…

This special issue's editors invited discussion of three broad questions. Slightly rephrased, they are: How well do self-report data represent theoretical constructs? How should analyses of data be conditioned by properties of self report data? In what ways do interpretations of self-report data shape interpretations of a study's findings? To…

Previous research shows that the direction of rating scales can influence participants' response behavior. Studies also suggest that the device used to complete online surveys might affect the susceptibility to these effects due to the different question layouts (e.g., horizontal grids vs. vertical individual questions). This article contributes…

Purpose: This study aims to investigate the preferences of 96 educational researchers on the use of digital technologies in scientific research. Design/methodology/approach: The study was designed as a quantitative-dominant sequential explanatory mixed-method research. Findings: Despite the spreading use of advanced technologies of big data and…

Assessing the quality of education is a vital stipulation for all graduate programs that aim to secure and bolster their current rank among similar programs. Program evaluation is usually carried out by parties not directly related to a program. In other words, outsiders evaluate programs. Insiders who have first-hand experiences and impressions…