Competency in the new literacies of the Internet is essential for participating in contemporary society. Researchers studying these new literacies are recognizing the limitations of traditional methodological tools and adapting new technologies and new media for use in research. This paper reports our exploration of usability testing software to observe the Internet literacy practices of adolescents during homework tasks. Data consisted of visual screens capturing all activity, including students' faces, and oral think-alouds carried out as students did their homework. Using this software for data collection resulted in a more in-depth view of Internet literacy practices than what could be obtained by traditional methods. Students could work in their own homes and control recordings. Built-in data analyses and presentation components were also beneficial. However, time and cost considerations for the researcher became apparent. Most importantly, new ethical issues arise with the use of new research tools such as privacy and "incidental data". (Contains 2 tables and 3 figures.)