Though factors contributing to difficulty in learning school subjects including Mathematics were extensively studied, nature and characteristics of mathematics, possibly, one among the foremost causes for difficulty in learning it has not received required attention. To bring attention to the difficulties arising out of the nature of mathematics teaching-learning, this study identifies and compares the level of difficulty of major school subjects perceived by students. The study categorizes the characteristics of subjects that contribute to student perception of difficulty. Then it compares Mathematics with other school subjects on these perceived reasons. Questionnaire survey on a sample comprising of 300, 8th standard students randomly selected from schools of Kerala is employed. Findings indicate that as to mathematics, most of these identified factors are highly causative to difficulty compared to other subjects. The study implies reducing the difficulties in learning Mathematics through remedial measures that consider special nature of that subject.