In order to ensure content validity by covering a broad range of content domains, the testing times of some educational large-scale assessments last up to a total of two hours or more. Performance decline over the course of taking the test has been extensively documented in the literature. It can occur due to increases in the numbers of: (a)…

This ethnographic case study, situated in Newfoundland and Labrador, Canada, examined the effects of full-scale provincial testing on families, its influences on homework, and familial accountability for teaching and learning. Data were drawn from family interviews, as well as letters and documents regarding homework. Teachers sensed a significant…

Understanding the cognitive processes, skills and strategies that examinees use in testing is important for construct validity and score interpretability. Although response processes evidence has long been included as an important aspect of validity (i.e., "Standards for Educational and Psychological Tests," 1999), relevant studies are…

Examinees with item preknowledge tend to obtain inflated test scores that undermine test score validity. With the availability of process data collected in computer-based assessments, the research on detecting item preknowledge has progressed on using both item scores and response times. Item revisit patterns of examinees can also be utilized as…

As the use of process data in large-scale educational assessments is becoming more common, it is clear that data on examinees' test-taking behaviors can illuminate their performance, and can have crucial ramifications concerning assessments' validity. A thorough review of the literature in the field may inform researchers and practitioners of…

The purpose of this quantitative study was to provide an initial analysis of variables including academic courses, demographics, and clinical experience used as predictive measures of board certification achievement. With the growing need for perfusionists due to an increase in cardiac procedures and retirement, first-time pass rate on board…

Tests are often applied to evaluate students' academic performance in all educational contexts. In order to be successful in the tests, students are required not only to possess the knowledge of the subject, but also test-taking strategies which enable them to gain higher test score. The present study was aimed at investigating the relationship…

Perceived test importance and test-taking effort are typically measured after test completion, contrary to the temporal ordering specified by expectancy-value theory. Retrospective importance and effort scores may reflect students' self-protective attributions of performance, which would support collection of prospective importance and effort…

It is imperative to collect validity evidence prior to interpreting and using test scores. During the process of collecting validity evidence, test developers should consider whether test scores are contaminated by sources of extraneous information. This is referred to as construct irrelevant variance, or the "degree to which test scores are…

Pedagogical content knowledge (PCK) is an important target of science teacher knowledge assessment. Most studies that have assessed the PCK across a large sample of science teachers used a text-based approach to elicit and assess the more declarative and static form of teachers' PCK. Recently, small-scale qualitative studies have adopted a novel…

Cognitive psychologists have found that taking practice tests improves students' learning, and some claim that tests that require recall are more effective than those that require recognition. This study examined whether recognition (i.e., multiple-choice) quizzes were as effective as cued-recall (i.e., fill-in-the-blank) quizzes for improving…

Studies have shown that test-takers tend to use keyword-matching strategies when taking listening tests. Keyword-matching involves matching content words in the written modality (test items) against those heard in the audio text. However, no research has investigated the effect of such keywords in listening tests, or the impact of gazing upon…

Assessment of learners in the anatomical sciences is a complex task as it not only tests students' fact knowledge, but also the analysis of visual information. Sometimes, novice histology learners must acquire image recognition skills of microscopic structures in a short time frame. This paper describes a strategy of offering first year dental…

Four decades of research have shown that students' low test-taking effort is a serious threat to the validity of score-based inferences from low-stakes, group-based educational assessments. This meta-analysis sought to identify effective interventions for improving students' test-taking effort in such contexts. Included studies: (1) used a…

Different variants of the selected-response (SR) item type have been developed for various reasons (i.e., simulating realistic situations, examining critical-thinking and/or problem-solving skills). Generally, the variants of SR item format are more complex than the traditional multiple-choice (MC) items, which may be more challenging to test…