Twins regularly score nearly a standard deviation below the population mean on standardized measures of cognitive development in infancy but recover to the population mean by early childhood, making rapid gains through the toddler years. To date, only polynomial growth models have been fit to model cognitive recovery across childhood, limiting the applicability of the growth parameters to later developmental periods. We fit a nonlinear asymptotic Gompertz growth model to prospective cognitive scores from 1,153 individual twins from 578 families (47.9% male, 91.5% White, 61.6% monozygotic) measured at 16 time points between 3 months and 15 years. Twins displayed a lower asymptote of 86.47 (0.90 SD below the population mean) and gained on average 17.01 points, achieving an upper asymptote of 103.48. Growth was observed to be most rapid at 3.26 years, highlighting the importance of the toddler years in cognitive development. Biometric analyses revealed that shared environmental factors accounted for the majority of the variance in initial cognitive ability as well as asymptotic growth in cognitive ability. Gestational age and family socioeconomic status (SES) were robust predictors of cognitive growth. Results from the present study provide insight into the growth processes underlying the recovery of cognitive ability to the population mean for children evincing slight delays in their initial cognitive ability. In particular, findings highlight prenatal factors and family economic resources as important aspects of the environment in the recovery of cognitive ability.