This study investigated factors negatively affect English language speaking skills in Saudi colleges for girls in the South in terms of: a) Instructors. b) Students. c) Curriculum and textbook. d) English Language teaching methods and exercises. e) Teaching and learning environment. To collect data for the study, a questionnaire papers were distributed to 150 students studying at Mhayeal and Almajardah colleges of King Khalid University (KKU) at English languages department, and 10 female instructors were interviewed about the students' questionnaire information. Data generated were subjected to descriptive and analytical approach using SPSS. The findings were: 1. Using Arabic in class affect students' proficiency. 2. Students fear speaking English Language in public and can't make a phone conversation, presentation in English without Arabic translation. 3. Curriculum of listening and speaking does not contain enough exercises for speaking skills. 4. Instructors do not use strategies that develop speaking such as: role-play, debates, and presentation - assignment. 5. More time is devoted to listening skills than speaking skills. 6. Labs are not used for teaching listening and speaking skills. 7. Rarely CD is used as speaking model. 8. More than 30 students are in listening and speaking class. It has been strongly recommended: 1. Prohibit the students from using Arabic in English Language classes. 2. Use motivating teaching strategies such as: cultural debatable topics, discussions, role-play, and presentations - assignment to develop speaking proficiency. 3. Teach Listening and speaking course in the lab. 4. Increase the time of listening and speaking course to six hours instead of three to develop speaking proficiency. 5. Activate English club and societies inside the colleges. 6. Students' number in listening and speaking class must not exceed 30.