High test scores may measure general intelligence or test taking "savvy" rather than acquisition of knowledge of a particular subject. Pretests may help instructors differentiate between material students already know and good performance based on flaws in the wording of tests as indicated by pretests administered to college chemistry students. (Author/JN)