Atypical pitch processing is a feature of Autism Spectrum Disorder (ASD), which affects non-tone language speakers' communication. Lifelong auditory experience has been demonstrated to modify genetically-predisposed risks for pitch processing. We examined individuals with ASD to test the hypothesis that lifelong auditory experience in tone language may eliminate impaired pitch processing in ASD. We examined children's and adults' Frequency-following Response (FFR), a neurophysiological component indexing early neural sensory encoding of pitch. Univariate and machine-learning-based analytics suggest less robust pitch encoding and diminished pitch distinctions in the FFR from individuals with ASD. Contrary to our hypothesis, results point to a linguistic pitch encoding impairment associated with ASD that may not be eliminated even by lifelong sensory experience.