ERIC Number: EJ1369295
Record Type: Journal
Publication Date: 2023-Mar
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1759-2879
EISSN: EISSN-1759-2887
End-User Understanding of Qualitative Comparative Analysis Used within Evidence Synthesis: A Mixed-Methods Study
Kahwati, Leila C.; Kelly, Bridget J.; Johnson, Mihaela; Clark, Rachel T.; Viswanathan, Meera
Research Synthesis Methods, v14 n2 p180-192 Mar 2023
Background: Enhanced uptake of systematic reviews that use qualitative comparative analyses (QCA) requires knowing how end-users interpret such findings. The study purpose was to identify effective approaches to communicating results from a QCA within a systematic review. Methods: Sequential exploratory mixed methods design; thematic analysis of interviews with 11 end-users followed by a randomized experiment with 254 participants that provided QCA results for a hypothetical review presented through three formats (text, table, and figure). A survey administered after the experiment assessed subjective and objective comprehension of QCA results. Results: Interview themes included use of jargon; appropriate use of appendices, tables, figures; and integration of QCA results within the systematic review. In the experiment, we observed a significant difference (p = 0.035) in subjective comprehension across the three presentation formats. Participants randomized to the figure and text formats scored higher compared to the table. No significant differences were observed for objective comprehension overall (p = 0.11). However, for parameter interpretation (a unique component of QCA results), scores among participants that received the figure format were significantly higher than scores for participants who received the text (p = 0.001) or table (p = 0.004). No significant differences (p = 0.09) were observed in objective comprehension for configuration interpretation. Conclusions: End-users of systematic reviews saw value in the use of QCA, but unfamiliar methods and terminology were barriers to full understanding of the findings. When presenting results, a figure format appears to be superior to text or table formats based on measures of subjective comprehension and some measures of objective comprehension.
Descriptors: Qualitative Research, Mixed Methods Research, Comparative Analysis, Interviews, Tables (Data), Language Usage, Visual Aids, Layout (Publications), Scores, Comprehension, Barriers, Measurement Techniques
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://bibliotheek.ehb.be:2191/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Agency for Healthcare Research and Quality (AHRQ) (DHHS/PHS)
Authoring Institution: N/A
Grant or Contract Numbers: 1R03HS02625801