This study determines the critical success factors for students and academic staff when applying and evaluating online delivery methods in colleges and universities in Kuwait. The recently implemented eLearning systems and methods in the country, due to the COVID-19 pandemic, are evaluated and the perception of the eLearning system is gauged. Targeted surveys are distributed to a representative sample of undergraduate engineering students and academic staff. The following critical success factors are considered: benefits of the eLearning system, educational system quality, information quality, instructor quality, learner quality, service quality and technical system quality. Results show that there is a correlation between the perceptions of students and academic staff, particularly regarding instructor quality, information quality and benefits of the eLearning system. Both groups of respondents agreed on the high importance of instructor quality and the low importance of benefits.