The idea of sources other than the test-takers' knowledge leading to different results on high-stakes tests was the motif based on which the present investigation was initiated on the probable sources of unreliability of a test. For this purpose, the researchers went through a thorough literature review with the aim to identify the issues to be…

The contemporary era of learning-oriented assessment (LOA) demands teacher professional efforts to appropriately and accurately assess learners' attainment and use the assessment results for the enhancement of learning. In second/foreign language (L2) discipline, this has recently brought language assessment literacy (LAL) to the forefront,…

Language testing and assessment have grown in popularity and gained significance in the last few decades, and there is a rising need for assessment literate stakeholders in the field of language education. As teachers play a major role in assessing students, there is a need to make sure they have the right level of assessment knowledge and skills…

In the current study, the validity of C-Test is investigated using the construct identification approach. Based on construct identification approach, the factors which are deemed to affect item difficulty in C-Test items were identified. To this aim, 11 factors were selected to enter into Linear Logistic Testing Model (LLTM) analysis to…

Individuals are controlled by tests in every advanced society when they want to be admitted in educational courses, to proceed from one stage to the next, or to be given a certificate (Shohamy, 2001b). Accordingly, the present study was carried out to construct and validate educational, social, and psychological consequences questionnaires of…

Critical language assessment (CLA) has been addressed in numerous studies. However, the majority of the studies have overlooked the need for a practical framework to measure the CLA dimension of teachers' language assessment literacy (LAL). This gap prompted us to develop and validate a critical language assessment literacy (CLAL) scale to further…

Threats to construct validity should be reduced to a minimum. If true, sources of bias, namely raters, items, tests as well as gender, age, race, language background, culture, and socio-economic status need to be spotted and removed. This study investigates raters' experience, language background, and the choice of essay prompt as potential…

The present study was designed basically to develop a psycho-motor mechanism scale based on the theory of translation competence proposed by PACTE (2003), and then to assess the validity and reliability of the constructed scale. In this quantitative research, after designing the scale, two translation tasks were given to 90 M.A. students majoring…

The purpose of the present study was to explore validity of the University Entrance Examination for applicants into English Master's Programs in Iran (Master's UEE) with respect to the Messickian validity framework using the Rasch model. The data of 18821 test takers taking the 2009 version of the UEE were analyzed with Winsteps and R package eRm.…

Many researchers were interested in validity of the language proficiency tests in the previous decades. The present study aims to study the construct validity of the Ministry of Science, Research, and Technology Reading Comprehension module (MSRT) in the Iranian context. After administering a standard language proficiency test (OPT) 65…

Three approaches of validation enquiry were applied on the data obtained from a proficiency test carried out with 3,398 PhD candidates as a partial requirement for entering PhD program in Iran. The data obtained from the reading section were subjected to an exploratory factor analysis (EFA). The EFA yielded nine factors in the reading section.…

To investigate the construct validly of a section of a high stakes test, an exploratory factor analysis using principal components analysis was employed. The rotation used was varimax with the suppression level of 0.30. Eleven factors were extracted out of 35 reading comprehension items. The fact that these factors emerged speak to the construct…

The study was conducted with 3,385 participants who took an English language proficiency test as a partial requirement for entering a PhD program in different fields of education. This test has three sections which are grammar, vocabulary and reading comprehension. To determine the construct validity of the test, a series of analyses were done.…