Background: The introduction of the Australian Research Training Scheme has been a strong reason for assuring the quality of the research higher degree (RHD) experience; if students experience poor supervision, an unsupportive climate, and inadequate infrastructure, prior research suggests RHD students will be less likely to complete their degree,…

Peer review is a gatekeeper, the final arbiter of what is valued in academia, but it has been criticized in relation to traditional psychological research criteria of reliability, validity, generalizability, and potential biases. Despite a considerable literature, there is surprisingly little sound peer-review research examining these criteria or…

The peer review process used to select manuscripts for publication in academic journals is important to the individual researcher and the scientific community, but it has been the topic of little research. This article analyzes the reviewers overall recommendation, ratings on specific subscales, and written critiques. Reviewer reliability is…

Reanalyzed data from the Self-Description Questionnaire II (SDQII) from an earlier study of 376 gifted students, and a new study of 837 gifted students to explore alternative approaches to missing data and data normalization. Results strongly support the construct validity of responses to the SDQII by gifted adolescents. (SLD)

Evaluated external assessor ratings of the quality of the research team and the proposed research for proposals submitted to the Australian Research Council large grants program. Data from 313 evaluations show that the reliability of the assessments varied systematically with the number of assessors and the score considered. Discusses implication…

Over 1,000 undergraduate and graduate business administration majors from 100 different classes provided course and instructor evaluations at the end of each class, and again at least one year after program completion. Results showed large and statistically significant correlations between end-of-term and retrospective ratings. (Author/GDC)

In five studies, the applicability of two North American instruments for student evaluation of teacher performance was assessed at the University of Western Sydney (Macarthur, Australia). Results of a multitrait-multimethod analysis indicate the instruments are applicable at this institution and across diverse educational settings. (Author/MSE)

Results of a reanalysis of previously published data (B. M. Byrne, 1989) support the correlated uniqueness model, diagnostic tests of the validity of confirmatory factor analysis (CFA), multitrait multimethod (MTMM) solutions, inclusion of external validity in MTMM design, and application of factorial invariance to test stability of CFA-MTMM…

Findings and research designs used to study university students' evaluations of teaching effectiveness are reviewed. A construct validation approach which recognizes the multidimensionality of both effective teaching and students' evaluations is recommended for further research. (BS)

A number of research reports and meta analyses on student evaluation of college teaching were reviewed. Student ratings were found to be multidimensional, reliable, valid, and relatively unbiased. Results were useful for feedback, course selection, and personnel decisions. Marsh's Students' Evaluations of Educational Quality (SEEQ) was also…

Results of a follow-up study of the same students used in the Feldman study indicate that individual student evaluations are remarkably stable over time and more reliable than previously assumed. There was systematic information in individual student ratings that internal consistency approaches have ignored or assumed to be nonexistent.…

The "Students Evaluation of Educational Quality" is an instrument measuring dimensions of college teaching effectiveness. A study showed that, for ratings of 123 instructors in 3,079 classes over 13 years, each instructor has a distinct profile of ratings that generalizes over time, different courses, and course level. (Author/MSE)

Recent research (1978-1982) on student evaluations of teaching is reviewed, including: influence of background variables pertaining to the student, the teacher, and the learning environment; the dimensions of the teaching being evaluated; the validity of students' evaluations; the "Doctor Fox" effect and its implications for validity; the…

College instructors evaluted the quality of their own teaching and were evaluated by their students in 331 different courses. Student evaluations of teaching correlated with instructor self evaluations in courses taught by teaching assistants, in undergraduate courses taught by faculty, and in graduate level courses, demonstrating their validity…