The purpose of this qualitative research study is to analyze instructors' exam questions at a Primary Education Department in terms of the exam's period, the comprehensibility of the instructions, cognitive level, and the appropriateness to the critical thinking. This qualitative study is based on document analysis method. 100 randomly selected…

Researchers (Sandarg & Schomber, 2009; Wilkerson, Schomber, & Sandarg, 2004) have urged the profession to develop a new subject-matter licensure test to reflect the best practices in the foreign language classroom. In October 2010, the Praxis II: World Language Test joined the Praxis Series. Given that this standards-driven test differs…

Coherence is the core principle underlying standards-based educational reforms. Assessments aligned with content standards are designed to guide instruction and raise achievement. The authors investigate the coherence of standards-based reform's key instruments using the Surveys of Enacted Curriculum. Analyzing 138 standards-assessment pairs…

Measurement and evaluation of students' achievement are an important aspect to make sure that students really understand the course content and monitor students' achievement level. Performance is not only reflected from the numbers of high achievers of the students, but also on quality of the grade obtained; does the grade "A" truly…

This research inquires into the effectiveness of the two predominant forms of questions--multiple-choice questions and short-answer questions--used in the State University Entrance Examination for Chemistry including the relationship between performance and gender. It examines not only the style of question but also the content type examined…

Involving students in peer review has many pedagogical benefits, but few studies have explicitly investigated relationships between the content of peer reviews, student perceptions and assessment outcomes. We conducted a case study of peer review within a third-year undergraduate subject at a research-intensive Australian university, in which we…

School districts and states across the Regional Educational Laboratory Mid-Atlantic Region and the country as a whole have been modifying their teacher evaluation systems to identify more effective and less effective teachers and provide better feedback to improve instructional practice. The new systems typically include components related to…

This report describes the processes undertaken to revise the IDEA Student Ratings of Instruction (SRI) system. The previous revision occurred in 1999, as described in IDEA Technical Report No. 11, "Revising the IDEA System for Obtaining Student Ratings of Instructors and Courses" (Hoyt, Chen, Pallett, & Gross, 1999). The procedures…

Content balancing is one of the most important components in the computerized adaptive testing (CAT) especially in the K to 12 large scale tests that complex constraint structure is required to cover a broad spectrum of content. The purpose of this study is to compare the weighted penalty model (WPM) and the weighted deviation method (WDM) under…

This study lies at an intersection between advancing educational data mining methods for detecting students' knowledge-in-action and the broader question of how conceptual and mathematical forms of knowing interact in exploring complex chemical systems. More specifically, it investigates students' inquiry actions in three computer-based models of…

Learning or performance gains are often measured in improvements of test scores over time. However, learners may also answer questions incorrectly which they appeared to master previously, making claims about overall learning gains problematic. Using data from 1,211 grade 6 learners in the Umgungundlovu district in KwaZulu-Natal, we interrogated…

This paper describes an exploration into a reform of the A-level qualification in England in 2008; namely, the introduction of the "stretch and challenge" policy. This policy was initiated by the exams regulator and determined that exam papers should be redesigned to encourage the application of higher order thinking skills, both in the…

This paper addresses the ideal of "citizenship" in the US and how particular meanings of history, culture, and language are encoded in government policy and practice. The US government (Citizenship and Immigration Services) presents citizenship as a commitment to shared knowledge and values, and it requires applicants to possess…

Test-takers' interpretations of validity as related to test constructs and test use have been widely debated in large-scale language assessment. This study contributes further evidence to this debate by examining 59 test-takers' perspectives in writing large-scale English language tests. Participants wrote about their test-taking experiences in…

Assembling equivalent test forms with minimal test overlap across forms is important in ensuring test security. Chen and Lei (2009) suggested a exposure control technique to control test overlap-ordered item pooling on the fly based on the essence that test overlap rate--ordered item pooling for the first t examinees is a function of test overlap…