Although it has long been acknowledged that interviewers play a crucial role in the survey data collection process, there is little research concerning interviewer effects on how respondents perceive the interview. We investigate whether interviewer effects exist regarding how much respondents report having enjoyed the interview and whether these…

Previous work has demonstrated similarities and differences between aerial and terrestrial image viewing. Aerial scene categorization, a pivotal visual processing task for gathering geoinformation, heavily depends on rotation-invariant information. Aerial image-centered research has revealed effects of low-level features on performance of various…

Methods of network meta-analysis (NMA) can be classified as arm-based and contrast-based approaches. There are several arm-based approaches, and some of these have been criticized because they recover inter-study information and hence do not obey the principle of concurrent control. Here, we point out that recovery of inter-study information in…

I propose two practical advances to the argument-based approach to validity: developing a living document and incorporating preregistration. First, I present a potential structure for the living document that includes an up-to-date summary of the validity argument. As the validation process may span across multiple studies, the living document…

Monitoring the fidelity with which implementers implement behavioral procedures is important, but individuals tasked with monitoring fidelity may have received little training. As a result, their data may be affected by variations in implementers' performance, such as the frequency of fidelity errors. To determine the extent to which the frequency…

Estimating prescription medicine use is challenging due to recall bias associated with surveys and coverage bias in administrative data. This study assesses how making operational improvements and combining both survey and administrative data sources can increase data quality on filled prescriptions. We use data from the Medicare Current…

Systematic reviews are a time-consuming yet effective approach to understanding research trends. While researchers have investigated how to speed up the process of screening studies for potential inclusion, few have focused on to what extent we can use algorithms to extract data instead of human coders. In this study, we explore to what extent…

The five SEERNet digital learning platforms (DLPs) present unique opportunities for researchers by offering tools, processes, and infrastructure to make research more efficient, scalable, and relevant. However, conducting research within a DLP may require a shift in a researcher's orientation or mindset in how they think about potential research…

Big Data offers opportunities and challenges in all aspects of human life. In relation to research ethics, Big Data represents a normative difference in degree rather than a difference in kind. Data are more messy, rapid, difficult to predict, and difficult to identify owners; but the principles of informed consent, confidentiality, and prevention…

Higher education is awash with data that, when refined, facilitates data-informed decisions. Such decision-making is much more prevalent in support of undergraduate education given the much larger number of undergraduates pursuing higher education in contrast to the much smaller proportion of graduate students. A simple extension of current…

During the COVID-19 pandemic, organizations increased virtual programming and adoption of online technologies. This article outlines the University of California assessment of tools for gathering data on participant learning outcomes from virtual educational programs. After assessing colleagues' experiences and searching for new web applications,…

This article considers the multiple relations that emerge from and between Facebook commenters, as well as between commenters, researchers, and the research project during recruitment. To do so, we draw on our experiences of recruiting individuals who have concerns about or are opposed to a range of recent social and legal changes in…

This paper considers how effectively inspection takes account of the 'lived experience' of young people in school and in their leisure time, and identifies some weaknesses in both data gathering and reporting. It asserts that Ofsted should be more forthright in its judgments of the curriculum range now offered in schools, and regrets its lack of…

Data extraction is a time-consuming and resource-intensive task in the systematic review process. Natural language processing (NLP) artificial intelligence (AI) techniques have the potential to automate data extraction saving time and resources, accelerating the review process, and enhancing the quality and reliability of extracted data. In this…

Multi-lab projects are large scale collaborations between participating data collection sites that gather empirical evidence and (usually) analyze that evidence using meta-analyses. They are a valuable form of scientific collaboration, produce outstanding data sets and are a great resource for third-party researchers. Their data may be reanalyzed…