The feasibility of the administration, scoring, and reporting of an on-line concept mapping system has been studied in collective research in which concept map construction systems were designed to allow students individually and collaboratively to construct concept maps on the computer to measure content understanding and collaboration. The study reported an attempt to implement a closed map construction system using expert-constructed concept maps to provide automated scoring and feedback for student-constructed concept maps. Participants were 138 middle school and high school students in 9 classes in 4 schools. Each student completed one of two on-line concept mapping tasks, one a collaborative task for three students and the other an individual problem-solving and search task. Students used the Hyper-Card concept mapping software developed for the study. Descriptive statistics associated with the concept maps were semantic content score, organizational structure score, number of terms used, and number of concept links formed. A total of 22 group concept maps were scored according to expert criteria, and pairwise agreement results for the scoring systems appeared to be good, with exact agreement percentages in the 80% range. (Contains 2 figures, 2 tables, and 14 references.) (SLD)