Despite the centrality of the Common European Framework of Reference for Languages (CEFR) in language teaching and assessment, studies investigating its learning outcomes in language program evaluations are quite scarce. This paper aims to evaluate the effectiveness of a modular English preparatory school program through the Foreign Language Skills Scale. The research sample consists of 357 preparatory school students having attained B1+ level of proficiency in the program. The results revealed that while the language program designed to be in line with the CEFR guidelines, in general, serves for the needs of the students, there are still some discrepancies between the learning outcomes of B1+ and opinions of students about their competencies, especially in listening sub-skills.