This study was based on the hypothesis that students' epistemological beliefs could become more expertlike with a combination of appropriate instructional activities: (i) preclass reading with metacognitive reflection, and (ii) in-class active learning that produces cognitive dissonance. This hypothesis was tested through a five-year study involving close to 1000 students at two institutions, in four physics courses. Using an experimental design, data from student interviews, writing product assessments, and the Discipline- Focused Epistemological Beliefs Questionnaire (DFEBQ) we demonstrate that the beliefs of novice science learners became more expert-like on 2 of the 4 DFEBQ factors. We conclude that a combination of an activity that gets students to examine textual material metacognitively (Reflective Writing) with one or more types of in-class active learning interventions can promote positive change in students' epistemological beliefs.