Online tests offer many advantages but they still belong to assessment, which may make learners have anxiety. Thus, students may experience certain emotion. Academic emotion is a branch of emotion and has great effects on student learning. Such effects can be associated with individual differences, especially prior knowledge. To this end, this…

The study investigated hurdles to the quality of student learning assessment by examining issues related to assessment procedures and practices, learners and learning, learning resources and test constructs, and test admin and feedback. Quantitative and qualitative data were collected from two Ethiopian universities using two types of…

Exams are a form of assessment that is ubiquitous in college STEM classrooms yet is infrequently studied from the experiential perspectives of instructors or students. To better understand the forms, methods, and experiences of college STEM exams, we conducted survey-based research with instructors in anatomy and physiology courses, a well-defined…

Multiple-choice quizzes (MCQs) are a popular form of assessment. A rapid shift to online assessment during the COVID-19 pandemic in 2020, drove the uptake of MCQs, yet limited invigilation and wide access to material on the internet allow students to solve the questions via internet search. ChatGPT, an artificial intelligence (AI) agent trained on…

Researchers have used different measures to examine participants' second-language (L2) proficiency, yet it remains unclear how these different measures influence research results on the effect of L2 proficiency on the target variable. The present research explored the modulation effect of four different measures of L2 Chinese proficiency on…

The development of students' higher order learning is a critical component of education. For decades, educators and scientists have engaged in an ongoing debate about whether higher order learning can only be enhanced by building a base of factual knowledge (analogous to Bloom's taxonomy) or whether higher order learning can be enhanced directly…

Expanding the scope of previous undergraduate research assessment tools, the "Entering Research" Learning Assessment (ERLA) measures undergraduate and graduate research trainee learning gains in the seven areas of trainee development in the evidence-based "Entering Research" conceptual framework: Research Comprehension and…

In the fall of 2014, the University at Buffalo created a new universal Student Evaluation of Teaching (SET). The purpose of the present study was to establish the construct validity of SET items. Rasch analyses of data from 7 semesters (N=203,194 students) revealed problems with item fit indices and threshold distances. Changes to items and…

Increased understanding of the importance of the affective domain in chemistry education research has led to the development and adaptation of instruments to measure chemistry-specific affective traits, including motivation. Many of these instruments are adapted from other fields by using the word "chemistry" in place of other…

To measure the response style of acquiescence, researchers recommend the use of at least 15 items with heterogeneous content. Such an approach is consistent with its theoretical definition and is a substantial improvement over traditional methods. Nevertheless, measurement of acquiescence can be enhanced by two additional considerations: first, to…

Writing multiple-choice test items to measure student learning in higher education is a challenge. Based on extensive scholarly research and experience, the author describes various item formats, offers guidelines for creating these items, and provides many examples of both good and bad test items. He also suggests some shortcuts for developing…

Research on the test structure of the Force Concept Inventory (FCI) has largely ignored gender, and research on FCI gender effects (often reported as "gender gaps") has seldom interrogated the structure of the test. These rarely crossed streams of research leave open the possibility that the FCI may not be structurally valid across…

This paper explores, through the use of the observation checklist and Conversation Analysis (CA), the discourse functions elicited by the dialogic task of the Free University of Bolzano (IT) speaking test. It aims to contribute to content validation, which has been claimed to be especially relevant in paired speaking tests, where interaction is…

Test-takers' voices in relation to high-stakes language tests have received growing attention in recent years. While the perspectives of this stakeholder group can be utilised to improve test quality, test-taking experience, and test impact, we argue that this goal needs to be achieved by considering a fundamental shift in our conceptualisation of…

Our paper aims at analysing the linguistic "features" produced by Arabic learners of Italian as a foreign language. There are published studies of common errors for Arab students of Italian (Della Puppa, 2006; Giacalone Ramat et al., 2001). However, this study introduces the standardized language assessment, namely the CILS test of…