In a study investigating the effects of student engagement in inquiry learning through the development of Web sites, nearly every student reported having enjoyed the project, and the majority scored an A or B for their project grade. However, neither enjoyment nor high achievement on this performance task necessarily translated into high scores on the unit test. Therefore, this paper explores why success in a technology rich inquiry environment did not translate to measurable changes in student learning. Results demonstrated that students were not accustomed to this type of pedagogy and that the assessment did not match the task.