This article examines the impact that an 'epistemically insightful' approach to informal science learning can have on students' attitudes, aspirations and perceptions of STEM subjects. It uses interim findings from a research and outreach project, including sustained Saturday activity programmes for ages 14-16 and residential summer schools for ages 15-19, designed to create confident scholars who can engage with difficult philosophical questions raised by current technological advances. The Inspiring Minds project at Canterbury Christ Church University, Kent, UK, delivers informal science learning in schools and informal settings based on an epistemic insight-led approach to STEM outreach and education.