Although it has long been acknowledged that interviewers play a crucial role in the survey data collection process, there is little research concerning interviewer effects on how respondents perceive the interview. We investigate whether interviewer effects exist regarding how much respondents report having enjoyed the interview and whether these…

Previous work has demonstrated similarities and differences between aerial and terrestrial image viewing. Aerial scene categorization, a pivotal visual processing task for gathering geoinformation, heavily depends on rotation-invariant information. Aerial image-centered research has revealed effects of low-level features on performance of various…

Methods of network meta-analysis (NMA) can be classified as arm-based and contrast-based approaches. There are several arm-based approaches, and some of these have been criticized because they recover inter-study information and hence do not obey the principle of concurrent control. Here, we point out that recovery of inter-study information in…

I propose two practical advances to the argument-based approach to validity: developing a living document and incorporating preregistration. First, I present a potential structure for the living document that includes an up-to-date summary of the validity argument. As the validation process may span across multiple studies, the living document…

Estimating prescription medicine use is challenging due to recall bias associated with surveys and coverage bias in administrative data. This study assesses how making operational improvements and combining both survey and administrative data sources can increase data quality on filled prescriptions. We use data from the Medicare Current…

Systematic reviews are a time-consuming yet effective approach to understanding research trends. While researchers have investigated how to speed up the process of screening studies for potential inclusion, few have focused on to what extent we can use algorithms to extract data instead of human coders. In this study, we explore to what extent…

Big Data offers opportunities and challenges in all aspects of human life. In relation to research ethics, Big Data represents a normative difference in degree rather than a difference in kind. Data are more messy, rapid, difficult to predict, and difficult to identify owners; but the principles of informed consent, confidentiality, and prevention…

Higher education is awash with data that, when refined, facilitates data-informed decisions. Such decision-making is much more prevalent in support of undergraduate education given the much larger number of undergraduates pursuing higher education in contrast to the much smaller proportion of graduate students. A simple extension of current…

During the COVID-19 pandemic, organizations increased virtual programming and adoption of online technologies. This article outlines the University of California assessment of tools for gathering data on participant learning outcomes from virtual educational programs. After assessing colleagues' experiences and searching for new web applications,…

This article considers the multiple relations that emerge from and between Facebook commenters, as well as between commenters, researchers, and the research project during recruitment. To do so, we draw on our experiences of recruiting individuals who have concerns about or are opposed to a range of recent social and legal changes in…

Data extraction is a time-consuming and resource-intensive task in the systematic review process. Natural language processing (NLP) artificial intelligence (AI) techniques have the potential to automate data extraction saving time and resources, accelerating the review process, and enhancing the quality and reliability of extracted data. In this…

Multi-lab projects are large scale collaborations between participating data collection sites that gather empirical evidence and (usually) analyze that evidence using meta-analyses. They are a valuable form of scientific collaboration, produce outstanding data sets and are a great resource for third-party researchers. Their data may be reanalyzed…

In this paper, we propose a new method for selecting cases for in situ, immediate interview research: detector-driven classroom interviewing (DDCI). Published work in educational data mining and learning analytics has yielded highly scalable measures that can detect key aspects of student interaction with computer-based learning in close to…

Accurate data extraction is a key component of evidence synthesis and critical to valid results. The advent of publicly available large language models (LLMs) has generated interest in these tools for evidence synthesis and created uncertainty about the choice of LLM. We compare the performance of two widely available LLMs (Claude 2 and GPT-4) for…

The number of meta-analyses of aggregate data has dramatically increased due to the facility of obtaining data from publications and the development of free, easy-to-use, and specialised statistical software. Even when meta-analyses include the same studies, their results may vary owing to different methodological choices. Assessment of the…