As the cradle of cultivating talents, universities are facing great opportunities and challenges in their education. Among them, IPE (ideological and political education), as an important foundation for the future growth of university students, is of great significance. This paper discusses the relationship between IPE and psychological fitness education in university teaching. This paper expounds the necessity and feasibility of playing the role of psychological fitness education in IPECU (ideological and political education in colleges and universities). Based on this, this paper gives the strategy of infiltrating psychological fitness education into IPE. This paper combines NN (neural network) method to construct an assessment model of IPE quality. In this paper, MATLAB is used for simulation and comparative analysis. The final experiment shows that the RMSE of this algorithm is 0.512, MAE is 1.089, and the accuracy of the algorithm is 0.958.