Assessment and LEarning in Knowledge Spaces (ALEKS), a technology-based mathematics curriculum, was piloted in the 2012-2013 school year at a Minnesota rural public middle school. The goal was to find an equivalent or more effective mathematics teaching method than traditional direct instruction. The purpose of this quantitative study was to compare the effectiveness of online instruction through ALEKS and traditional classroom direct instruction. Middle school mathematics student achievement was based on the Minnesota Comprehensive Assessment (MCA-III) and district-developed summative grade level concept test during the 2012-2013 school year. The findings show grades six and eight student achievement was significantly different, in favor of direct instruction, when comparing instruction methods on the district-developed concept tests. Grade seven student achievement was significantly different, in favor of direct instruction, when comparing instruction methods on the official spring 2013 MCA-III. When controlling for demographics, grade seven student achievement was significantly different, in favor of direct instruction, due to special education status. This research is valuable to mathematics teachers, curriculum directors, and principals evaluating the advances in mathematics instruction due to technology and the evolving future of education. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://bibliotheek.ehb.be:2222/en-US/products/dissertations/individuals.shtml.]