A study investigated the relationships among nine instruments designed to measure clinical knowledge and performance in a third-year surgery clerkship. Results suggest that various types of measures are necessary for broad evaluation of clinical performance. Instruments clustered into two groups: measures of medical knowledge and clinical…

Interrater reliability in numerical ratings of clerkship performance (n=1,482 students) in five surgery programs was studied. Raters were classified as accurate or moderately or significantly stringent or lenient. Results indicate that increasing the proportion of accurate raters would substantially improve the precision of class rankings. (MSE)

Extensive research efforts in the past decade have measured academic proficiency and progress in both theory and practice of large-scale writing assessment. The following major situational variables were identified in these investigations: (1) topic variables such as writing prompts, subject matter, mode of discourse, length, and rhetorical…

This paper provides an overview of standardized tests and a summary of important psychometric and test construction properties that educators must consider when they make critical evaluations of standardized tests. Sections of the paper concern: (1) basic characteristics of standardized tests; (2) differences between norm-referenced and…

Medical school admission interview ratings for four entering classes (n=356 students) were compared with preadmission academic variables (admission test scores, undergraduate grades), student characteristics (age, gender, residence), and interviewer characteristics (gender, professional background, admission committee membership). Recommendations…

A study found that trained standardized patients could provide a reliable assessment of English proficiency of foreign medical graduates by comparison with a standardized language test, but further research is needed to determine whether it is necessary to provide a clinical context for language assessment. (MSE)

To determine if different graded word lists can be used interchangeably for assessment purposes, and to determine if age, grade, or sex affects performance on the different graded word lists, a study examined the Wide Range Achievement Test (WRAT), Levels I and II, the San Diego Quick Assessment, and the Graded Word Reading Test by F.J. Schonell.…

Communicative competence is often characterized as an integrated control of language reflected in the speaker's ability to understand and use language appropriately for communication in various situations. The theoretical basis for the communicative competence construct is the anthropological, sociolinguistc, and pragmatic view of language.…

An examination of the applicability of self-assessment as a tool for student placement in foreign language instruction focused on: (1) the ability of first-year university students to assess their performance level in the second language through a self-assessment questionnaire; (2) the quality of the questionnaire itself and its potential for…

Classroom teachers have the best possible vantage point for constructing locally appropriate surveys and tests; the fact is, however, that teachers tend to rely on nationally mass-produced and marketed test packages. The purpose of this paper is to present a procedure for developing and refining teacher-made surveys and tests, which would be valid…

Higher education relies on student ratings to evaluate faculty teaching, partly because the alternatives (expert peer appraisals or objective performance criteria) are costly or unavailable. Because student ratings are crucial not only to improving instruction, but also in making or breaking faculty careers, it is important to assure that they…

The lack of a German language testing instrument for economic literacy has led to problems for researchers in German-speaking countries to establish the level of economic literacy in those countries. The translation of the 23rd edition (1987) of the Test of Economic Literacy (TEL) into a German version, known as the Wirtschalfliche Bildung Test…

This study investigated the testing of speaking vocabulary in English as a Second Language (ESL) at a university in Hawaii. A Speaking Vocabulary Test (SVT) was developed and piloted with college students. Test-takers (n=37) were divided into three groups: native English-speaking freshmen and sophomores; non-native English-speaking freshmen,…

This paper presents a primer on building a scientifically oriented teacher evaluation instrument. It stresses the importance of accurate measures and accepts the presupposition that scientific approaches provide the most accurate measures of student teacher performance. The paper discusses the scientific concepts of validity and reliability, and…

In a study of the reliability of an English language proficiency test for non-native teaching assistants (NNS TAs), 18 NNS TAs were administered the SPEAK Test. The results were compared with student evaluations of the intelligibility and clarity of the TAs' classroom speech. Despite problems with the SPEAK Test, the measure was considered a…