Humans rely on two main systems of quantification; one is nonsymbolic and involves approximate number representations (known as the approximate number system or ANS), and the other is symbolic and allows for exact calculations of number. Despite the pervasiveness of the ANS across development, recent studies with adolescents and school-aged children point to individual differences in the precision of these representations that, importantly, have been shown to relate to symbolic math competence even after controlling for general aspects of intelligence. Such findings suggest that the ANS, which humans share with nonhuman animals, interfaces specifically with a uniquely human system of formal mathematics. Other findings, however, point to a less straightforward picture, leaving open questions about the nature and ontogenetic origins of the relation between these two systems. Testing children across the preschool period, we found that ANS precision correlated with early math achievement but, critically, that this relation was nonlinear. More specifically, the correlation between ANS precision and math competence was stronger for children with lower math scores than for children with higher math scores. Taken together, our findings suggest that early-developing connections between the ANS and mathematics may be fundamentally discontinuous. Possible mechanisms underlying such nonlinearity are discussed. (Contains 3 figures and 2 tables.)