ERIC Number: EJ760703
Record Type: Journal
Publication Date: 2006
Pages: 9
Abstractor: Author
ISBN: N/A
ISSN: ISSN-0092-1815
EISSN: N/A
The Criterion-Related Validity of a Computer-Based Approach for Scoring Concept Maps
Clariana, Roy B.; Koul, Ravinder; Salehi, Roya
International Journal of Instructional Media, v33 n3 p317-325 2006
This investigation seeks to confirm a computer-based approach that can be used to score concept maps (Poindexter & Clariana, 2004) and then describes the concurrent criterion-related validity of these scores. Participants enrolled in two graduate courses (n=24) were asked to read about and research online the structure and function of the heart and circulatory system, to construct a concept map, and then to write a 250-word essay on this topic. Pathfinder and Latent Semantic Analysis approaches were used to analyze the data. Term agreement with an expert was significantly related to human-rater concept map scores (r 0.75). All of the computer-derived scores were significantly correlated to human-rater essay scores (maximum r = 0.83). These results indicate that automatically derived concept map scores can provide a relatively low-cost, easy to use, and easy to interpret measure of students' science content knowledge. (Contains 1 chart.)
Descriptors: Semantics, Human Body, Test Validity, Anatomy, Concept Mapping, Scores, Computer Assisted Testing, Higher Education, Graduate Students, Interrater Reliability, Test Interpretation, Science Education, Science Instruction, Science Achievement, Student Evaluation, Criterion Referenced Tests
Westwood Press Inc. 118 Five Mile River Road, Darien, CT 06820-6237. Tel: 202-656-8680; Fax: 203-656-8680; Web site: http://www.adprima.com/ijim.htm
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A