NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1406641
Record Type: Journal
Publication Date: 2024
Pages: 24
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1364-5579
EISSN: EISSN-1464-5300
How Much Do Survey Response Rates Affect Relationships among Variables?
Terry A. Beehr; Minseo Kim; Ian W. Armstrong
International Journal of Social Research Methodology, v27 n1 p63-86 2024
Previous research extensively studied reasons for and ways to avoid low response rates, but it largely ignored the primary research issue of the degree to which response rates matter, which we address. Methodological survey research on response rates has been concerned with how to increase responsiveness and with the effects of response rates on variables' means and frequencies. More important to theory-oriented research, however, are effects of response rates on effect sizes (strength of relationships between variables). We examined recent survey research (446 correlations in 252 studies 2000-2020) on commonly studied variables in the example domain of organizational behavior, where surveys are especially common. We found a nonsignificant relationship (r = 0.01) between response rates and effect sizes. The relationship between sample sizes (the numerator in response rates) and effect sizes was weak but significant (r = 0.13, p = 0.01). Furthermore, there was no evidence for variability across studies and no curvilinear effects. Response rates on surveys have no noticeable effect on correlations nor therefore on theory development and testing.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A