Being looked at is an important communicative signal, and attenuated responses to such direct gaze have been suggested as an early sign of autism. Using live eye tracking, we examined whether direct gaze elicits different gaze responses in infants at ages 10, 14 and 18 months with and without later autism in real-life interaction. The sample consisted of 169 infants: 35 with elevated likelihood of autism and subsequent diagnosis, 94 without subsequent diagnosis and 40 with typical likelihood of autism. Infants in all groups tended to look more towards the adult's face shortly after the direct gaze occurred. Neither how much nor how quickly the infants responded to the direct gaze differentiated the without elevated likelihood of autism and subsequent diagnosis and with elevated likelihood of autism and subsequent diagnosis groups. Infants in the typical likelihood group looked more at the face after the direct-gaze event than infants in the two elevated likelihood groups, but this result is tentative. In an exploratory analysis, infants in the elevated likelihood of autism and subsequent diagnosis group looked away quicker from faces with direct gaze than infants in the typical likelihood group, but this measure did not correlate with dimensional autism or differentiate between the two elevated likelihood groups. The current results suggest that attenuated behavioural responses to direct gaze in infancy are neither strong nor specific early markers of autism.