Perception is not an independent, in-the-moment event. Instead, perceiving involves integrating prior expectations with current observations. How does this ability develop from infancy through adulthood? We examined how prior visual experience shapes visual perception in infants, children, and adults. Using an identical task across age groups, we exposed participants to pairs of colorful stimuli and implicitly measured their ability to discriminate relative saturation levels. Results showed that adult participants were biased by previously experienced exemplars, and exhibited weakened in-the-moment discrimination between different levels of saturation. In contrast, infants and children showed less influence of memory in their perception, and they actually outperformed adults in discriminating between current levels of saturation. Our findings suggest that as humans develop, their perception relies more on prior experience and less on current observation.