This study investigated the cross-sectional relationships between reading-related affective and cognitive factors and reading skills among adolescents with and without dyslexia. Participants were 120 Chinese-speaking eighth graders, including 60 adolescents with dyslexia and 60 typically developing adolescents from Hong Kong, China. Adolescents completed questionnaires on general anxiety, reading anxiety, and reading self-concept. They were also assessed on measures of rapid digit naming, verbal working memory, word reading, reading fluency, and reading comprehension. The results showed that readers with dyslexia reported higher levels of general anxiety and reading anxiety and lower levels of reading self-concept than typical readers. They also showed difficulties in rapid digit naming and verbal working memory. Importantly, controlling for rapid digit naming and verbal working memory, reading self-concept was uniquely associated with word reading and reading fluency for readers with and without dyslexia. Furthermore, reading anxiety and reading self-concept were uniquely associated with reading comprehension for the two groups of readers. The findings point to the importance of considering affective factors when examining the reading skills of Chinese readers and the utility of targeting these factors when supporting the learning of adolescents with and without dyslexia.