In this article, I suggest that the question whether the proper place for philosophy of education is in the domain of philosophy or the domain of education cannot be resolved as long as we think of the connection between philosophy and education in terms of the idea of "philosophy of education". To substantiate this point, I look into the history of the idea of "philosophy of education", both as a general idea and with regard to the way in which it became institutionalised in universities in the English-speaking world. I contrast this with the way in which the academic study of education developed in German-speaking countries in order to highlight that "philosophy of education" is not the only way in which philosophy and education can be connected. Being aware that the connection between philosophy and education can be made differently not only provides a way out of the discussion about the proper identity and location of philosophy of education, but also hints at forms of philosophically informed scholarship that are more firmly based with the academic field of education rather than that they remain a halfway house in between philosophy and education.