Although it has long been acknowledged that interviewers play a crucial role in the survey data collection process, there is little research concerning interviewer effects on how respondents perceive the interview. We investigate whether interviewer effects exist regarding how much respondents report having enjoyed the interview and whether these…

Previous work has demonstrated similarities and differences between aerial and terrestrial image viewing. Aerial scene categorization, a pivotal visual processing task for gathering geoinformation, heavily depends on rotation-invariant information. Aerial image-centered research has revealed effects of low-level features on performance of various…

Methods of network meta-analysis (NMA) can be classified as arm-based and contrast-based approaches. There are several arm-based approaches, and some of these have been criticized because they recover inter-study information and hence do not obey the principle of concurrent control. Here, we point out that recovery of inter-study information in…

Monitoring the fidelity with which implementers implement behavioral procedures is important, but individuals tasked with monitoring fidelity may have received little training. As a result, their data may be affected by variations in implementers' performance, such as the frequency of fidelity errors. To determine the extent to which the frequency…

Estimating prescription medicine use is challenging due to recall bias associated with surveys and coverage bias in administrative data. This study assesses how making operational improvements and combining both survey and administrative data sources can increase data quality on filled prescriptions. We use data from the Medicare Current…

Systematic reviews are a time-consuming yet effective approach to understanding research trends. While researchers have investigated how to speed up the process of screening studies for potential inclusion, few have focused on to what extent we can use algorithms to extract data instead of human coders. In this study, we explore to what extent…

During the COVID-19 pandemic, organizations increased virtual programming and adoption of online technologies. This article outlines the University of California assessment of tools for gathering data on participant learning outcomes from virtual educational programs. After assessing colleagues' experiences and searching for new web applications,…

Accurate data extraction is a key component of evidence synthesis and critical to valid results. The advent of publicly available large language models (LLMs) has generated interest in these tools for evidence synthesis and created uncertainty about the choice of LLM. We compare the performance of two widely available LLMs (Claude 2 and GPT-4) for…

There is a growing need to empirically evaluate the quality of online instructional interventions at scale. In response, some online learning platforms have begun to implement rapid A/B testing of instructional interventions. In these scenarios, students participate in series of randomized experiments that evaluate problem-level interventions in…

The method of web probing integrates cognitive interviewing techniques into web surveys and is increasingly used to evaluate survey questions. In a usual web probing scenario, probes are administered immediately after the question to be tested (concurrent probing), typically as open-ended questions. A second possibility of administering probes is…

The number of meta-analyses of aggregate data has dramatically increased due to the facility of obtaining data from publications and the development of free, easy-to-use, and specialised statistical software. Even when meta-analyses include the same studies, their results may vary owing to different methodological choices. Assessment of the…

Social network research often depends on the willingness of respondents to provide personal information about themselves and alters. Survey design strategies that increase willingness to share this information are necessary for social network research to be feasible, especially when name generators are used for sampling because rosters are…

In the present study, we examined the psychometric properties of the data obtained from the Commitment to Profession of Medicine Scale (CPMS) with 4-point, 5-point, 6-point, and 7-point response sets based on Item Response Theory (IRT). A total of 2150 medical students from 16 different universities participated in the study. The participants were…

The fullness of Black students' experiences in college has yet to be archived. The same can be said of Black people broadly, whose existence has long been reduced by and to what is observable, by systems of power and those at the helm. This is perhaps due to the structural and structural limitations of data collection efforts, or not of interest…

Dependability (also known as consistency) is one of four criteria in rigor and trustworthiness in qualitative research. In this article, the process of establishing consistency is discussed through the lenses of constructivism and interpretivism, as the observed social reality is viewed as epistemologically counter-intuitive. Two strategies were…