Corrective feedback is often touted as a critical benefit to learning, boosting testing effects when retrieval is poor and reducing negative testing effects. Here, we explore the dark side of corrective feedback. In three experiments, we found that corrective feedback on multiple-choice (MC) practice questions is later endorsed as the answer to related second-test questions, even though it is no longer correct. We describe this effect as an automatic influence of memory for feedback that participants fail to control. We explored how this influence is affected by the depth of retrieval during practice by successively increasing the retrieval demands of the MC practice test across the three experiments: Experiment 1 used a standard (select a single favorite option) format; Experiment 2 used ranking (rank order the options); and Experiment 3 used elimination testing (provide reasons for rejecting unchosen options). Increasing retrieval depth enhanced controlled influences on a cued-recall second test, evidenced by better accuracy on related versus new questions. However, it did not reduce the automatic influence on accuracy when the second test was MC, partly because repeating the options between practice and test likely led to false recognition of related questions. Together, the results suggest that MC practice tests produce both automatic and controlled memory influences on related second-test questions, with retrieval depth at practice being an important determinant of the controlled influence. However, whether that controlled influence will override the automatic influence of memory for the corrective feedback also depends on the second test format.