In low-stakes assessment settings, students' performance is not only influenced by students' ability level but also their test-taking engagement. In computerized adaptive tests (CATs), disengaged responses (e.g., rapid guesses) that fail to reflect students' true ability levels may lead to the selection of less informative items and thereby…

Change-point analysis (CPA) is a method for detecting abrupt changes in parameter(s) underlying a sequence of random variables. It has been applied to detect examinees' aberrant test-taking behavior by identifying abrupt test performance change. Previous studies utilized maximum likelihood estimations of ability parameters, focusing on detecting…

Because non-cognitive constructs can influence student success in education beyond academic achievement, it is essential that they are reliably conceptualized and measured. Within this context, there are several gaps in the literature related to correctly interpreting the meaning of scale scores when a non-standard response option like I do not…

It is imperative to collect validity evidence prior to interpreting and using test scores. During the process of collecting validity evidence, test developers should consider whether test scores are contaminated by sources of extraneous information. This is referred to as construct irrelevant variance, or the "degree to which test scores are…

Although the IELTS speaking test assesses English verbal-communication competence accurately and reliably, its traditional, retroactive scoring framework stops short of providing detailed diagnostic information about individual test-takers' specific domains of proficiency or deficiency. This study employed a cognitive diagnostic assessment (CDA)…

Achievement goal theory emphasizes the importance of achievement goals in learning behavior and performance, particularly in challenging tasks. However, little research has explored how achievement goals contribute to strategy use and integrated writing (IW) performance. The present study examined the relationship between achievement goals (task-,…

My dissertation research explored responder behaviors (e.g., demonstrating response styles, carelessness, and possessing misconceptions) that compromise psychometric quality and impact the interpretation and use of assessment results. Identifying these behaviors can help researchers understand and minimize their potentially construct-irrelevant…

Many students report increasing test anxiety in the months before taking the national social work licensure exam. We evaluate whether adding a test-anxiety-reduction module to an online exam preparation course reduces MSW students' test anxiety. A non-equivalent pretest-posttest control-group design was used to compare 42 students who did not…

Over the past decade, meta-analyses have been conducted to evaluate the impact of embodied pedagogical agents on learning outcomes. Most review studies have evaluated learning outcomes from the perspective of testing labels such as transfer, retention, recognition, free recall, and various other classifications. This is problematic, because…

The measurement of test-taking strategies and practices, mostly studied through qualitative methods, has been an important aspect of language testing and assessment research. The current study examines the test-taking strategies of International English Language Testing System (IELTS) test-takers and reports the process of designing and validating…

? frequently used indicator to reflect student performance is that of a test score. However, although tests are designed to assess students' knowledge or skills, other factors can also affect test results such as test-taking strategies. Therefore, the purpose of this study was to model the interrelationships among test-taking strategy instruction…

First-year seminars that teach foundational academic skills are common in universities around the world, but few studies have been conducted to determine whether the specific skills students develop in these courses transfer to other academic contexts. Our research presents a case study that addresses this gap by measuring students' perceptions of…

Unfavorable test-taking behaviors, such as speededness and disengagement, have long been a validity concern for large-scale low-stakes assessments. Understanding the presence and extent of such behaviors is important for ensuring the validity of inferences based on test scores. This study examined test-taking behaviors using item response time…

For efficiency, Computerized Adaptive Test (CAT) algorithm selects items with the maximum information, typically with a 50% probability of being answered correctly. However, examinees may not be satisfied if they only correctly answer 50% of the items. Researchers discovered that changing the item selection algorithms to choose easier items (i.e.,…

This study examined the effectiveness of the Carolina College Advising Corps (CCAC) on two college readiness outcomes: advanced college preparatory course enrollment and SAT test-taking behaviors. The focus of this study is on concrete college readiness measures beyond mere college aspirations, as these measures more accurately predict college…