Questionnaire designers are encouraged to write questions as complete sentences. In self-administered surveys, incomplete question stems may reduce visual clutter but may also increase burden when respondents need to scan the response options to fully complete the question. We experimentally examine the effects of three categories of incomplete…

In web surveys, no interviewer is present to clarify question comprehension problems, which can be particularly prevalent among respondents with low literacy skills. Although plain language is used in various contexts to improve text comprehensibility, its use in social science questionnaires has not been investigated to date. Using a…

Probes are follow-ups to survey questions used to gain insights on respondents' understanding of and responses to these questions. They are usually administered as open-ended questions, primarily in the context of questionnaire pretesting. Due to the decreased cost of data collection for open-ended questions in web surveys, researchers have argued…

The aim of the current study was to verify the internal and external validity of the construct of implicit beliefs concept in the sports context, the Conceptions of the Nature of Athletic Ability Questionnaire-2 (CNAAQ-2). The data of this study were collected from 322 adolescent football players by using CNAAQ-2 and MT (Mental Toughness)…

A process is proposed to create the one-dimensional expected item characteristic curve (ICC) and test characteristic curve (TCC) for each trait in multidimensional forced-choice questionnaires based on the Rank-2PL (two-parameter logistic) item response theory models for forced-choice items with two or three statements. Some examples of ICC and…

Implementation of Professional Learning Communities (PLCs) has become common place in schools across the globe. Perhaps, the prevailing definitions and operationalization of PLCs could explain the disparities in how they are executed in various contexts. By investigating a selection of recent studies, this review of literature aims to analyse how…

Online surveys are widely used in social science research as well as in empirical studies of open, online, and distance education. However, students' responses are likely to be at odds with their actual behavior. In this context, we examined the discrepancies between self-reported use and actual use (i.e., learning analytics data) among 20,646…

Questionnaire design choices, such as handling 'do not know' answers or using check all that apply questions may impact the level of item- and unit nonresponse. We used experimental data from an online panel and the questions of ESS to examine how applying forced answering, offering DK/NA options and specific question formats (CATA vs. forced…

We have less time and focus than ever before, while the demand for attention is increasing. Therefore, it is no surprise that when answering questionnaires, we often choose to strongly agree or be neutral, producing problematic and unusable data. The current study investigated forced-choice (ipsative) format compared to the same questions on a…

This study explores the feasibility of forming detailed inferences about museum visitor behavior based on analysis of data collected via "Dr. Discovery"--a mobile question-and-answer app. We analyzed 5656 questions asked by 795 visitor groups recorded by Dr. Discovery across two museums in the American Southwest. Analysis of this data…

The Creative Achievement Questionnaire (CAQ) is widely used to measure the creative achievement levels of individuals. Previous studies reported a varying range of reliability coefficients for the CAQ. To this date, no study has investigated the variability in the reliability coefficients of the CAQ. A random-effects reliability generalization…

This study examined the concordance between accelerometry-measured and self-reported physical activity (PA) and sedentary time in adults with autism. Twenty-four participants wore an ActiGraph GT3X + accelerometer for seven consecutive days and completed the International Physical Activity Questionnaire-Short Form (IPAQ-SF) on the last day of…

In this secondary analysis of a previously conducted systematic review, we analyze social validity assessments in intervention research for transition-age autistic youth. Social validity is concerned with the acceptability of the intervention goals, the acceptability and feasibility of the intervention procedures, and the perceived importance of…

Recent years have seen a growing number of studies investigating the accuracy of nonprobability online panels; however, response quality in nonprobability online panels has not yet received much attention. To fill this gap, we investigate response quality in a comprehensive study of seven nonprobability online panels and three probability-based…

Advance translation is a method of source questionnaire development for multilingual survey projects to enhance translatability and (inter)cultural portability. The aim is to minimize translation issues in the final translation stage. I empirically tested the results of a previously conducted advance translation in a think-aloud study and analyzed…