ERIC Number: EJ921303
Record Type: Journal
Publication Date: 2010-Dec
Pages: 8
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0021-9584
EISSN: N/A
Comparing Two Tests of Formal Reasoning in a College Chemistry Context
Jiang, Bo; Xu, Xiaoying; Garcia, Alicia; Lewis, Jennifer E.
Journal of Chemical Education, v87 n12 p1430-1437 Dec 2010
The Test of Logical Thinking (TOLT) and the Group Assessment of Logical Thinking (GALT) are two of the instruments most widely used by science educators and researchers to measure students' formal reasoning abilities. Based on Piaget's cognitive development theory, formal thinking ability has been shown to be essential for student achievement in science and chemistry courses. The major difference between TOLT and GALT is two concrete items relating to conservation of mass and volume, which GALT contains over and above TOLT. The first intent of this study was to determine whether the two concrete items represent an advantage for the general chemistry population in terms of test reliability, discriminatory power, and item bias. Accordingly, TOLT and "TOLT + 2" (TOLT with the extra two concrete items) were each administered to a sample of over 900 students enrolled in first-semester general chemistry. The two concrete items were not observed to provide any advantage, and DIF analysis suggests that TOLT is tenably a less biased test. The second part of the study entailed a direct comparison between TOLT and GALT as intact instruments. GALT was found to have no advantage over TOLT in terms of reliability, discriminatory power, or potential item bias for either general chemistry or preparatory chemistry students. (Contains 4 tables and 3 figures.)
Descriptors: Test Bias, Test Reliability, Chemistry, Logical Thinking, Thinking Skills, Cognitive Development, Comparative Analysis, Cognitive Tests, Item Analysis, Undergraduate Study, Measurement Techniques, Evaluation Methods
Division of Chemical Education, Inc and ACS Publications Division of the American Chemical Society. 1155 Sixteenth Street NW, Washington, DC 20036. Tel: 800-227-5558; Tel: 202-872-4600; e-mail: eic@jce.acs.org; Web site: http://pubs.acs.org/jchemeduc
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Group Assessment of Logical Thinking
Grant or Contract Numbers: N/A