How do children construct a concept of natural numbers? Past research addressing this question has mainly focused on understanding how children come to acquire the cardinality principle. However, at that point children already understand the first number words and have a rudimentary natural number concept in place. The question therefore remains; what gets children's number learning off the ground? We therefore, based on previous empirical and theoretical work, tested which factors predict the first stages of children's natural number understanding. We assessed if children's expressive vocabulary, visuospatial working memory, and ANS (Approximate number system) acuity at 18 months of age could predict their natural number knowledge at 2.5 years of age. We found that early expressive vocabulary and visuospatial working memory were important for later number knowledge. The results of the current study add to a growing body of literature showing the importance of language in children's learning about numbers.