The use of online student response systems (OSRSs) is increasing within tertiary education providers, however, research investigating their potential to enhance student engagement is limited. The aim of the current study was to examine the impact of an OSRS using an experimental crossover design. Quantitative data measuring student engagement was compared from pre- to post-intervention. A qualitative analysis was used to further investigate student perceptions of the OSRS. The results from this study suggest that OSRSs may be appropriate tools to increase student engagement in undergraduate statistics classes. Despite no significant change in engagement scores observed when students were exposed to the OSRS than when they were not, students appreciated the novelty of the OSRS and perceived it to have had a positive impact on their learning experience. Suggestions for how to exploit the advantages of OSRSs and directions for further research are discussed.