The development of Q methodology is briefly reviewed, and the methodology itself is briefly described. Finally, a number of the issues are raised relating to the use of Q. Q methodology can have fruitful applications if it is not used indescriminately. Appropriate use of Q requires careful attention to the way the problems being researched are…

Based on a comparison of criterion-based, checklist scoring of medical students' patient interviewing skills and the traditional method of faculty observation, it is suggested that the latter method is less reliable. (MSE)

This document consists of papers published in the electronic journal "Practical Assessment, Research & Evaluation" during 2000-2001: (1) "Advantages of Hierarchical Linear Modeling" (Jason W. Osborne); (2) "Prediction in Multiple Regression" (Jason W. Osborne); (3) Scoring Rubrics: What, When, and How?"…

The purpose of this study was to develop an instrument to examine students' behaviors in physical education classes that might have an impact on classroom management and student learning. The study was conducted in multiple phases, including instrument development, preliminary study, content validity study, and a reliability and validity study.…

This pamphlet explains a child's Massachusetts Comprehensive Assessment System (MCAS) "Student Report for Parents/Guardians." In spring 1999, more than 210,000 students from grades 4, 8, and 10 in Massachusetts took the state's MCAS tests. All public students in grades 4, 8, and 10 are required to participate, and the Education Reform…

The literature on alternatives to student ratings as means of evaluating college teaching is reviewed. Conclusions focus on the validity and reliability of such alternatives as peer evaluation, administrative ratings, self-evaluation, direct measurement of student achievement, and systematic observation of teacher behavior. (Author/MLW)

Evaluation research has established that college student ratings of faculty are reliable, valid, and widely used. However, resistance continues. Minimizing this resistance is crucial, and designating an influential change advocate within the institution can influence acceptance of a new system. Research on institutional contexts for evaluation…

Proposes a four-factor model of attitudes toward computers and describes a factor analysis conducted with preservice teachers to test its validity and reliability. Sex differences, degree of comfort or anxiety with computers, liking for computers, and value placed on computers are examined, and implications for further research are suggested.…

Discusses a history professor's attempt to awaken students' interest by assigning an oral history project rather than a traditional research paper. Reports that adding to the personal dimension to the project increased students enthusiasm and introduced them to problems of historical research and historiography. Includes problems of reliability…

Discussion of performance assessment focuses on a study that was part of the International Evaluation of Achievement of computer education that tested students in grades 8 and 11 on word processing performance tasks. Results are examined to determine the useability, reliability, and validity of the process. (eight references) (LRW)

Examines the use of various statistical techniques for generating domain-oriented multiword vocabulary terms for natural language database systems. Conclusions show the vocabulary clustering effect should be considered when making significance calculations and that a simple ratio of subject matter relative frequency to total sample relative…

Describes the development of an instrument for evaluating building-level school library media programs based on "Information Power," the American Association of School Libraries' guidelines for such programs. Data collection at an Oklahoma teleconference is described, the use of factor analysis is explained, construct validity is…

Assessments of 41 mentally ill adults (consumers of mental health services) of their level of functioning were compared with assessments by family members and mental health services case managers. Moderate correlations are found among the perspectives, and the relevance of the three perspectives for community-based service provision is discussed.…

Analyses of 10 raters' reasoning during think-aloud interviews provided evidence to support a model of the fundamental processes involved in rating standards-based, nonprescriptive portfolios. This process model provides a framework within which to conceptualize sound-rater reasoning and to identify reasoning that distorts the meaning of scores.…

This article proposes that college students will contribute most effectively to institutional assessment efforts if they understand how meaningful their input is. This can be accomplished if the assessment system is compassionate, considerate, convenient, communicated clearly, cohesive, understandable, concise, committed, attributes improvements…