In recent years, there has been a massive expansion of dual language education (DLE) programs across the United States. Many of these programs are located in relatively affluent areas with large numbers of white professional families. Yet, most Latinx students attend high-poverty schools. In this article, we use the School District of Philadelphia as a case study of efforts to expand DLE in such high-poverty schools with large concentrations of Latinx students. We first offer a historical overview of bilingual education in Philadelphia, emphasizing the ways that broader political and economic challenges impeded efforts to develop and sustain quality programs. We then examine a recent effort to expand DLE in the district. Using case studies of three different schools, we illustrate the ways that broader racialized histories that have created and exacerbated the segregation and poverty of Latinx communities within the city have made it difficult for these programs to be successfully implemented.