The credibility of conclusions arrived at in quantitative research depends, to a large extent, on the quality of data collection instruments used to quantify language and non-language constructs. Despite this, research into data collection instruments used in Applied Linguistics and particularly in the thesis genre remains limited. This study…

Different definitions and tests of dyslexia can cause unfairness and make life difficult for people with dyslexia as well as for the professionals. In 2012, the Danish government decided to support the fight against dyslexia. The government issued a public tender for the development of "a standardized, electronically administered test of…

How can we test whether state-of-the-art generative models, such as Blender and GPT-3, are good AI teachers, capable of replying to a student in an educational dialogue? Designing an AI teacher test is challenging: although evaluation methods are much-needed, there is no off-the-shelf solution to measuring pedagogical ability. This paper reports…

As part of an investigation into the relationship between classroom dialogue and student outcome, a test of reasoning has been developed that is suitable for preadolescents (i.e. c.10-13-year-olds). Building on previous work but expanding this considerably, the test focuses upon four areas of reasoning: differentiation of facts from opinions,…

Bias assessment (systematic errors) is fundamental in industry and service laboratories, where reliable results must be obtained to give correct answers to specific problems. Therefore, knowledge and practice in quality methodologies is of fundamental importance for students. Unfortunately, laboratory lessons often focus on connecting theory and…

Experimental psychology is witnessing an increase in research on individual differences, which requires the development of new tasks that can reliably assess variations among participants. To do this, cognitive researchers need statistical methods that many researchers have not learned during their training. The lack of expertise can pose…

Examinations form part of the assessment processes that constitute the basis for benchmarking individual educational progress, and must consequently fulfill credibility, reliability, and transparency standards in order to promote learning outcomes and ensure academic integrity. A randomly selected question examination (RSQE) is considered to be an…

It is important to define what an error in a question paper is so that there is a common understanding and to avoid people's own conceptions impacting upon the way in which they write or check question papers. We carried out an interview study to investigate our colleagues' definitions of error. We found that there is no single accepted definition…

This study aims to develop a knowledge test to assess secondary school students' awareness of scientists. After determining the topics that the questions in the test would measure, 50 multiple-choice questions were prepared and presented to six experts in the field. Following the experts' feedback, the number of questions in the test was reduced…

In this digital ITEMS module, Dr. Robert [Bob] Mislevy and Dr. Maria Elena Oliveri introduce and illustrate a sociocognitive perspective on educational measurement, which focuses on a variety of design and implementation considerations for creating fair and valid assessments for learners from diverse populations with diverse sociocultural…

Purpose: This study aims to describe the development and validation of a student survey instrument to assess academic advising services. The instrument was based on the SERVQUAL scale, a well-known instrument for service quality. Design/methodology/approach: A quantitative methodology was used. Data were collected through a structured…

This study aimed to develop a valid and reliable multiple-choice achievement test for the subject area of ecology. The study was conducted within the framework of exploratory sequential design based on mixed research methods, and the study group consisted of a total of 250 middle school students studying at the sixth and seventh grade level. In…

Patents are essential for university technology diffusion to society; however, patent quality in universities, especially in Latin America, has been poorly studied. We create a quality index for patents granted to regional universities by using patent quality variables as patent production, technical relevance, use of top knowledge, technological…

Background: Clinical swallowing assessment is largely limited to qualitative assessment of behavioural observations. There are limited quantitative data that can be compared with a healthy population for identification of impairment. The Test of Masticating and Swallowing Solids (TOMASS) was developed as a quantitative assessment of solid bolus…

The aim of the present study was to examine Turkish teacher candidates' competency levels in writing different types of test items by utilizing Rasch analysis. In addition, the effect of the expertise of the raters scoring the items written by the teacher candidates was examined within the scope of the study. 84 Turkish teacher candidates…