The New Standards Project (NSP) is an effort to create a state- and district-based assessment and professional development system to serve as a catalyst for major educational reform. As part of a professional development strategy tied to assessment, 114 teachers, curriculum supervisors, and assessment directors, representing 23 states and districts, met in Big Sky (Montana) on June 27 through July 1, 1992, to refine rubrics and procedures and score student responses from the spring 1992 field test of mathematics and English language arts performance tasks administered to close to 10,000 fourth graders in partner states and districts. Inter-scorer reliability estimates for reading and writing tasks were in the moderate range, below levels achieved with the use of large-scale writing assessments or standardized tests. Low reliability limits the use of these scores for making judgments about student performance or educational programs. Inter-scorer reliability for mathematics was somewhat higher, and levels were acceptable for six of seven tasks. Use of anaholistic and holistic scoring methods resulted in different scores for the same student response. The anaholistic "sum" was most similar to the holistic rating. Analysis of this pilot data does provide some direction for refinement and revision of tasks, rubrics, and scorer training. Findings are presented in 23 tables. (SLD)