Study abroad programs offer students an exciting and effective way to experience language and culture. It also helps students grow individually. However, administrators need to confirm the program's goals and objectives. This study examined the construct validity and reliability of a survey, which is the basis of development, conducted in a short-term study abroad program. Three main categories of the study abroad experience were examined: language, culture, and self-development. The results of a principal component analysis and Rasch model analysis indicated that the survey items are functioning appropriately and can be used for the basis in measuring the perceptions of students in a short-term study abroad program. Thus, the survey can help administrators assess their study abroad programs.