How does language shape mathematical development? In this article, we consider this question by reviewing findings from cross-sectional and longitudinal research. In this literature, we find that differences in the structures of languages and individual variations in language ability are associated with mathematical performance in both obvious and unexpected ways. We then consider the causal nature of these relations, with a focus on experimental studies that have tested the effects of language instruction on mathematical outcomes. Findings from this work show that certain forms of language instruction meaningfully improve performance in several mathematical domains, providing strong evidence of a linguistic pathway in mathematical development. However, much additional research is needed to understand how language instruction may be integrated optimally into math education. We conclude with recommendations for research.