This study examines the integration of virtual reality (VR) information technology in the teaching of systems of linear equations in three variables in a high school mathematics class. More broadly, the study investigates the effectiveness of digital teaching with respect to the learning process. The study tests two auxiliary teaching systems: a desktop-based VR system and an all-in-one VR system. Before and after the experiment, participants were asked to complete a questionnaire, and post-experiment interviews were conducted with both students and teachers, both of which provided quantitative and qualitative data for analysis. The result of data show that VR technology is a suitable tool for teaching high school mathematics, when it combined with the tradition curriculum were well-received and facilitate effective learning. In addition, the desktop-based VR system is found to be superior to the all-in-one VR system in terms of learning effectiveness since the high-efficiency display and better control.