Sensory systems are essential for perceiving and conceptualizing our semantic knowledge about the world and the way we interact with it. Despite studies reporting neural changes to compensate for the absence of a given sensory modality, studies focusing on the assessment of semantic processing reveal poor performances by deaf individuals when compared with hearing individuals. However, the majority of those studies were not performed in the linguistic modality considered the most adequate to their sensory capabilities (i.e., sign language). Therefore, this exploratory study was developed focusing on linguistic modality effects during semantic retrieval in deaf individuals in comparison with their hearing peers through a category fluency task. Results show a difference in performance between the two linguistic modalities by deaf individuals as well as in the type of linguistic clusters most chosen by participants, suggesting a complex clustering tendency by deaf individuals.