Measures of learning speed (i.e., the amount of learning/cumulative time learner spends engaged in an intervention) are rarely included in research designed to evaluate and compare academic interventions. We build a case that includes analyses of learning speed metrics in academic intervention research can provide more useful information for…

In health technology assessment (HTA), population-adjusted indirect comparisons (PAICs) are increasingly considered to adjust for the difference in the target population between studies. We aim to assess the conduct and reporting of PAICs in recent HTA practice, by performing, a methodological systematic review of studies implementing PAICs from…

The synthetic control method (SCM) is a popular approach for estimating the impact of a treatment on a single unit with panel data. Two challenges arise with higher frequency data (e.g., monthly versus yearly): (1) achieving excellent pre-treatment fit is typically more challenging; and (2) overfitting to noise is more likely. Aggregating data…

In the past couple of decades, the geoscience education community has made great strides toward investigating how to provide effective student learning experiences in the college setting. While experiences such as student-centered teaching strategies and course design elements are useful for the instructor, they may not make important elements of…

Testing English writing skills could be multi-dimensional; thus, the study aimed to compare students' writing scores calculated according to Classical Test Theory (CTT) and Multi-Facet Rasch Model (MFRM). The research was carried out in 2019 with 100 university students studying at a foreign language preparatory class and four experienced…

Developing models and using mathematics are two key practices in internationally recognized science education standards such as the Next Generation Science Standards (NGSS, 2013). In this paper, we used a virtual performance-based formative assessment to capture students' competencies at both "developing" and "evaluating"…

Classroom-based language assessments mainly include formative assessment and summative assessment, which are the most commonly used evaluation methods. The present study adopts a contrastive method to analyze the two types of assessments. Results of the study show that: 1) the characteristics of formative assessment contain teachers' adaptation to…

While peer evaluation has been widely used and studied in process-oriented writing classes, self-monitoring as a technique in writing instruction has been almost overlooked and is less explored in the Iranian English as a Foreign Language (EFL) context. The current research aimed to examine the impact of using the self-monitoring technique,…

This study aimed to investigate the effects of judgment frames, cues, and test criteria on the accuracy of metacomprehension monitoring. The design was a 2 (rating comprehension vs. predicting performance) × 2 (memory cues vs. comprehension cues) × 2 (detailed questions test vs. inferential questions test) mixed design with judgment frames and…

Bayesian methods have been said to solve small sample problems in frequentist methods by reflecting prior knowledge in the prior distribution. However, there are dangers in strongly reflecting prior knowledge or situations where much prior knowledge cannot be used. In order to address the issue, in this article, we considered to apply two Bayesian…

Learning-oriented assessment (LOA) is becoming increasingly popular in language education. The rationale for this popularity is the belief that LOA not only provides teachers with the necessary information for regular and ongoing evaluation but also it effectively assists learners in their learning process. This study attempted to examine the…

This paper proposes to use depth perception to represent raters' decision in holistic evaluation of ESL essays, as an alternative medium to conventional form of numerical scores. The researchers verified the new method's accuracy and inter/intra-rater reliability by inviting 24 ESL teachers to perform different representations when rating 60…

The conferment of tenure at a United States university provides substantial job security to its recipients. Tenure is designed to allow a professor the ability to explore new and risky research questions without fear of losing their position due to lack of publications. At the same time, this policy creates an incentive system with an ambiguous…

Considering the challenges associated with the teaching of engineering design, and recognising potential differences in design values of individuals from various backgrounds, this study investigated the utility of "adaptive comparative judgment" (ACJ) as a method for informing the teaching and practice of engineering design. The authors…

University rankings have gradually become an issue for concern in the academic community worldwide. Several mechanisms with different methodologies have been developed to rank the universities appropriately. However, some ranking tools have notable issues, especially with the indicators adopted. Some are based merely on research performance,…