The aim of this research was to analyze and compare analytic rubric and general impression scoring in peer assessment. A total of 66 university students participated in the study and six of them were chosen as peer raters on a voluntary basis. In the research, students were supposed to prepare a sample study within the scope of scientific research…

Due to myriad applications of the nominal group technique (NGT), a highly flexible iterative focus group method, researchers know little about its optimal scoring procedures. Exploring benefits and biases that such procedures might present, we aim to clarify how NGT scoring systems can privilege consensus or prioritization. In conducting the first…

The present study aimed to determine whether using culture-themed documentaries in Turkish teaching of B2 level international students has effects on the development of guided writing skills. The study had an action-research design, which is one of the qualitative study approaches. The study group consisted of 12 international students at the B2…

Using generalizability (G-) theory and rater interviews as both quantitative and qualitative approaches, this study examined the impact of scoring methods (i.e., holistic versus analytic scoring) on the scoring variability and reliability of an EFL institutional writing assessment at a Turkish university. Ten raters were invited to rate 36…

Organizational and applied sciences have long struggled with improving causal inference in quasi-experiments. We introduce organizational researchers to propensity scoring, a statistical technique that has become popular in other applied sciences as a means for improving internal validity. Propensity scoring statistically models how individuals in…

This article reports on a pedagogical project aimed at helping second language (L2) learners of English develop the ability to detect and appropriately interpret spoken sarcasm. The study used a pre- and posttest procedure to assess the development of learners' ability to both detect sarcasm and impute appropriate speaker intentions and attitudes…

Finding the match between individuals and educational treatments is the aim of both educators and the aptitude-treatment interaction research paradigm. Using the latent growth curve analysis, the present study investigates the interaction between the type of explicit instructional approaches (deductive vs. explicit-inductive) and the level of…

This work describes three case studies conducted to address two major problems in the area of chemistry education research, the lack of reported psychometrics regarding instrument scores, and the need for well-characterized assessments to evaluate college chemistry curricula. The first case study describes a psychometric evaluation of the Colorado…

This paper reports an investigation into how the prompt may influence the discourse of group oral tests. The group oral test, in which three or four participants are rated on their ability to discuss a prompt, is a format for assessing the spoken ability of language learners. In this study, 141 Japanese university students were videoed in 41 group…

Seventeen social educator students were taught to analyze their work activity by means of a Vygotsky-inspired method, drawing on Engeström's notion of an activity system. The method aimed at increasing the consciousness of the students of the structure of work activity system. The participants wrote two accounts of their field-work practice…

This catalog lists research reports, research notes, and other publications available from the College Board's website. The catalog briefly describes research publications available free of charge. Introduced in 1981, the Research Report series includes studies and reviews in areas such as college admission, special populations, subgroup…

The focus of the present study is on identifying categories of learning strategies that are mostly used by Russian university students in an English Linguistics Program with a TEFL concentration. The more specific goal of the study is to offer a model of evaluation of the effectiveness of TEFL-oriented programs in terms of the language learning…

What do we do when we read in another language? How do we make sense of the lexical and syntactic structures on the page? This study's development and use of the Miscue Coding for Metacognitive Strategies (MCMS), a foreign language assessment tool, offers language students and instructors a holistic approach to considering these questions. In this…

This is the second in a series of articles describing ongoing research that involves studying engineering college student graduation using Cox proportional hazards models. The first article, called "Proportional hazards models of graduation," was based on main effects models of graduation controlling for descriptors such as in-state residence,…

Engineering education, like many fields, has started to explore the benefits of concept maps as an assessment technique for knowledge integration. Because they allow students to graphically link topics and represent complex interconnections among diverse concepts, we argue that concept maps are particularly appropriate for assessing…