In 2013-14, the Wake County Public School System (WCPSS) launched Achieve3000 as a randomized controlled trial in 16 elementary schools. Achieve3000 is an early literacy program that differentiates non-fiction reading passages based on individual students' Lexile scores. Twoyear results show that Achieve3000 did not have a significant impact on student outcomes. However, both intent-to-treat and treatment-on-treated estimates show that in 2015, the second year of implementation, students in the treatment group outperformed their control-group counterparts by 0.13 standard deviation units (SD) on the year-end Achieve3000 LevelSet Lexile test. This effect size is consistent with mean empirical effect sizes reported by Lipsey et al. (2012). Yet in neither the pooled nor annual results did Achieve3000 significantly impact student performance on additional Lexile outcomes (EOG or DIBELS ORF). Both implementation and impact results for Achieve3000 suggest that the ability of this particular technology-based literacy solution to improve student performance beyond that of a control group fell short of vendor-defined and empirical expectations.