The consensus-based assessment has long been a prevalent methodology employed in "panel crit" settings in design education and professional design awards. Acknowledging the subjective nature of design evaluation and its importance to the design development process, we report two studies investigating the effect of three levels of design…

Validation is needed for any newly developed model or framework because it requires several real-life applications. The investment made into e-learning in medical education is daunting, as is the expectation for a positive return on investment. The medical education domain requires data-wise implementation of e-learning as the debate continues…

This article considers the epistemological chain in adventure sports coaching through personal experiences of undergraduate adventure students using semi-structured interviews and qualitative thematic analysis. Findings showed many observable practices utilised by adventure sport coaches were epistemologically sophisticated. This included…

For years, financial aid administrators and others have debated the nature and structure of need analysis. As it developed, need analysis was based on commonly accepted definitions and basic principles of economics. Beyond the fundamentals of need analysis, there also developed expertise about exercising professional judgment (PJ) in reviewing…

Generating own examples for previously encountered new concepts is a common and highly effective learning activity, at least when the examples are of high quality. Unfortunately, however, students are not able to accurately evaluate the quality of their own examples and instructional support measures such as idea unit standards that have been…

Any form of professional or occupational practice that requires independent agency has to rely heavily on the judgement of its practitioners. Yet the nature of professional judgement, like the nature of judgement more generally, is poorly understood. Almost as little understood is the nature of agential responsibility. The two are closely…

The process of determining whether a source of information is relevant is multidimensional, dynamic, and subjective. This essay puts information science scholarship on relevance, including the process and nature of making relevance judgments, in conversation with models of teaching and learning information literacy. Teaching librarians are…

Comparative judgment is gaining popularity as an assessment tool, including for high-stakes testing purposes, despite relatively little research on the use of the technique. Advocates claim two main rationales for its use: that comparative judgment is valid because humans are better at comparative than absolute judgment, and because it distils the…

This paper addresses a call for teachers to promote students' knowledge of criteria and standards within curriculum domains for self-monitoring and improvement purposes. We present the case for students to develop, as part of their learning in content areas, the evaluative knowledge and expertise of the type that teachers bring to the classroom.…

Sourcing is the ability to evaluate information by analysing source parameters such as author's expertise on a given topic. Past research, mostly based on school-related materials and tasks, shows that adolescents do not pay attention to source parameters when evaluating online scientific information. However, recent research has suggested that…

When a fingerprint is located at a crime scene, a human examiner is counted upon to manually compare this print to those stored in a database. Several experiments have now shown that these professional analysts are highly accurate, but not infallible, much like other fields that involve high-stakes decision-making. One method to offset mistakes in…

The purpose of this study was to better understand how middle school students consider the source of information when processing videos with conflicting information. To this end, we exposed a sample of seventh-graders to a series of videos in which two interviewees expressed divergent positions on a socioscientific issue ('Will organic farming be…

Background: YouTube is widely used for learning about scientific issues in and out of school. However, much of the scientific information on YouTube is inaccurate. Prior studies have mostly focused on how students evaluate textual online information sources and have not yet systematically examined how they evaluate authentic scientific YouTube…

Expert intuition is increasingly considered to be a valid form of knowledge, and research has proven its effectiveness in judgment and decision making in various fields. Theorists seem to recognize the contributions of intuition within evaluative practice, but it has never been well-documented. This article presents a study on expert intuition,…

The present study investigates teacher diagnostic skills when observing student engagement and inferring to underlying student characteristic profiles. Five student profiles as empirically determined in previous studies are selected: three incoherent (overestimating, uninterested, and underestimating) and two coherent (strong and struggling)…