Children affected by dyslexia exhibit a deficit in the categorical perception of speech sounds, characterized by both poorer discrimination of between-category differences and by better discrimination of within-category differences, compared to normal readers. These categorical perception anomalies might be at the origin of dyslexia, by hampering the set up of grapheme-phoneme correspondences, but they might also be the consequence of poor reading skills, as literacy probably contributes to stabilizing phonological categories. The aim of the present study was to investigate this issue by comparing categorical perception performances of illiterate and literate people. Identification and discrimination responses were collected for a /ba-da/ synthetic place-of-articulation continuum and between-group differences in both categorical perception and in the precision of the categorical boundary were examined. The results showed that illiterate vs. literate people did not differ in categorical perception, thereby suggesting that the categorical perception anomalies displayed by dyslexics are indeed a cause rather than a consequence of their reading problems. However, illiterate people displayed a less precise categorical boundary and a stronger lexical bias, both also associated with dyslexia, which might, therefore, be a specific consequence of written language deprivation or impairment.