Judgments of learning (JOLs) play a fundamental role in helping learners regulate their study strategies but are susceptible to various kinds of illusions and biases. These can potentially impair learning efficiency, and hence understanding the mechanisms underlying the formation of JOLs is important. Many studies have suggested that both…

For research evidence to inform decision making, an appraisal needs to be made of whether the claims are justified and whether they are useful to the decisions being made. This chapter provides a high level framework of core issues relevant to appraising the "fitness for purpose" of evidence claims. The framework includes (I) the…

Aim: Previous research has focused on accuracy associated with real and fake news presented in the form of news headlines only, which does not capture the rich context news is frequently encountered in real life. Additionally, while previous studies on evaluation of real and fake news have mostly focused on characteristics of the evaluator (i.e.,…

Teachers often face complex educational judgments and research has shown that teachers are prone to be influenced by unrelated information in their judgments and decisions. To investigate the influence of potential misinformation we employed a list-method directed forgetting paradigm and investigated a simulated judgment scenario, in which…

One of the many sources of information easily available to children is the internet and the millions of websites providing accurate, and sometimes inaccurate, information. In the current investigation, we examined children's ability to use credibility information about websites when learning about environmental sustainability. In two studies,…

Verbal testimony about reality status is critical but often contradictory. These studies address whom children consider reliable sources of information about reality and how they evaluate conflicting testimony. In Study 1, seventy 4- to 8-year-olds heard an adult or child provide testimony about how to cook food and use toys, and about the reality…

Recent studies have revealed that memory performance is better when participants have the opportunity to make a choice regarding the experimental task (choice condition) than when they do not have such a choice (fixed condition). These studies, however, used intentional memory tasks, leaving open the question whether the choice effect also applies…

The present study uses a quasi-experimental design to investigate the impact of team preferences on the accuracy of offside judgments. In Experiments 1 and 2, supporters of two German soccer clubs (i.e., Borussia Dortmund and FC Schalke 04) judged offsides in artificial scenes from a match between the clubs. We expected that supporters of both…

The "surprisingly popular" method (SP) of aggregating individual judgments has shown promise in overcoming a weakness of other crowdsourcing methods--situations in which the majority is incorrect. This method relies on participants' estimates of other participants' judgments; when an option is chosen more often than the average…

Proof is central to mathematics and has drawn substantial attention from the mathematics education community. Yet, valid and reliable measures of proof comprehension remain rare. In this article, we present a study investigating proof comprehension via students' summaries of a given proof. These summaries were evaluated by expert judges making…

Events worldwide have heightened concerns that education is failing to prepare students for a "post-truth" world. A core "post-truth" challenge is the prevalence of deep epistemic disagreements: people fundamentally disagree about appropriate ways of knowing. We provide a new analysis of deep epistemic disagreements and propose…

In collaborative problem solving, children produce and evaluate arguments for proposals. We investigated whether 3- and 5-year-olds (N = 192) can produce and evaluate arguments against those arguments (i.e., counter-arguments). In Study 1, each child within a peer dyad was privately given a reason to prefer one over another solution to a task. One…

The theory of mental models postulates that conditionals and disjunctions refer to possibilities, real or counterfactual. Factual conditionals, for example, "If there's an apple, there's a pear," parallel counterfactual ones, for example, "If there had been an apple, there would have been a pear." A similar parallel underlies…

Evidence of the internal consistency of standard-setting judgments is a critical part of the validity argument for tests used to make classification decisions. The bookmark standard-setting procedure is a popular approach to establishing performance standards, but there is relatively little research that reflects on the internal consistency of the…

Educational assessment involves eliciting, transmitting, and receiving information concerning the level of proficiency of a learner in a specified domain. With that in mind, it is perhaps surprising that the literature seems to make very little use of the signal processing metaphor. The present article begins by making a general case for greater…