Objective/Research Question: Community college "Promise" programs have proliferated recently, particularly in areas with many low-income, academically struggling students. Many Promise programs restrict eligibility by high school performance but set eligibility thresholds quite low. As such they function as "low-bar" merit scholarships, and merit scholarships are often believed to incentivize improved academic performance. But do such "low-bar" merit scholarships boost high school attendance and grades? Methods: We investigate impacts of one such program, the Milwaukee Area Technical College Promise, on high school students in Milwaukee Public Schools, exploiting program design features to identify treatment effects through a differences-in-differences strategy. Results: The program appears to have marginally improved high school grades while slightly lowering attendance. These effects cancel each other out in terms of meeting combined GPA and attendance eligibility thresholds. Estimated positive impacts on GPA were statistically significant but very small for males, Black students, free lunch eligible students, special education students and current English language learners, while impacts on attendance were negative for most subgroups. The positive GPA effect was restricted to the program's second year. Conclusions: We do not find strong evidence that low-bar scholarships are effective at improving academic performance. Policymakers should reconsider conventional wisdom underlying inclusion of merit criteria in broad-based scholarships.