Inductive reasoning is used when generalizing from particular cases to a general theory. The purpose of this paper is to present some highlights in the history of the problem of induction through notes on a selection of writers from ancient Greece to modern times. These notes contribute to the argument that there is a fundamental problem with inductive reasoning, which may interest mathematics teachers since it is used so often in statistics and STEM disciplines in general.