The prediction of physical ability is a key point to understand the physical training effect of college students. This paper uses the error Back Propagation neural network algorithms to investigate the college students' physical test results, and predicts the future trends of the results. The findings indicate that, in future ten years, the physical test grades of both men and women will slip to a certain extent. It implies that the indicators of speed, power, endurance level and physical strength of college students keep going down. This phenomenon should be paid attention to. It is necessary to strength the exercise consciousness, and stimulates the enthusiasm of students' exercise.