Since GPT-4's release it has shown novel abilities in a variety of domains. This paper explores the use of LLM-generated explanations as on-demand assistance for problems within the ASSISTments platform. In particular, we are studying whether GPT-generated explanations are better than nothing on problems that have no supports and whether GPT-generated explanations are as good as or better than teacher-authored explanations. This study contributes to existing literature since as of yet, there are no studies on the scale of ASSISTments evaluating the effectiveness of GPT support in education. Should GPT explanations prove effective then we plan to continue developing and evaluating explanations, hints, and other supports with GPT within ASSISTments. [[This paper was published in: "AIED 2024 Workshops, CCIS 2151," edited by A. M. Olney et al., Springer Nature Switzerland, 2024, pp. 369-374.]