In the current study, two pools of 250 essays, all written as a response to the same prompt, were rated by two groups of raters (14 or 15 raters per group), thereby providing an approximation to the essay's true score. An automated essay scoring (AES) system was trained on the datasets and then scored the essays using a cross-validation scheme. By…

Since researchers investigated automatic scoring systems in writing assessments, they have dealt with relationships between human and machine scoring, and then have suggested evaluation criteria for inter-rater agreement. The main purpose of my study is to investigate the magnitudes of and relationships among indices for inter-rater agreement used…

The present study aimed at characterizing what skilled or more proficient ESL college writing is in the Philippine setting through a contrastive analysis of three groups of variables identified from previous studies: resources, processes, and performance of ESL writers. Based on Chenoweth and Hayes' (2001; 2003) framework, the resource level…

As an alternative to rubric scoring, comparative judgment generates essay scores by aggregating decisions about the relative quality of the essays. Comparative judgment eliminates certain scorer biases and potentially reduces training requirements, thereby allowing a large number of judges, including teachers, to participate in essay evaluation.…

According to the literature, flipped teaching is a relatively new pedagogical approach in which the typical activities of classroom lectures followed by homework in common teaching practice are reversed in order, and most often integrated or supplemented with some types of instructional materials, such as instructional videos or PowerPoint files.…

The purpose of this study was to develop a Chorus Motivation Scale (CMS) that is tested in terms of reliability and construct validity by determining the student perceptions of effective motivation strategies in Chorus training in Turkish Music Teacher Training Model. In order to develop a Chorus Motivation Scale, Questionnaire-Effective…

The purpose of the study was to investigate the effects of two comprehensive argumentative writing interventions--Text Structure Instruction (TSI) and Text Structure Revision Instruction (TSRI)--on the eighth-grade students' ability to compose convincing essays that include structural elements of argumentative discourse. Both treatment groups…

A corpus of 313 freshman college essays was analyzed in order to better understand the forms and functions of humor in academic writing. Human ratings of humor and wordplay were statistically aggregated using Factor Analysis to provide an overall "Humor" component score for each essay in the corpus. In addition, the essays were also…

The present study discusses the relevance of measures of lexical diversity (LD) to the assessment of learner corpora. It also argues that existing measures of LD, many of which have become specialized for use with language corpora, are fundamentally measures of lexical repetition, are based on an etic perspective of language, and lack construct…

This study has attempted to investigate the administered written tests in the language department of Islamic Azad University of Hamedan, Iran from validity, practicality and reliability points of view. To this end two steps were taken. First, examining 112 tests, we knew that the face validity of 50 tests had been threatened, 9 tests lacked…

This study is an attempt to investigate the effect of direct and indirect feedback on the writing performance of Iranian learners of Japanese as a foreign language. During one academic semester, three indirect feedback types including underlining, coding and translation were used as well as direct type of feedback in order to see which one makes a…

Little is known about the effects of various planning and revising conditions on composition quality in experimental or TESOL education research. This study examined the effects of planning conditions (planning, prolonged planning, free writing, and control), subplanning conditions (task-given, task-content-given, and…

This study investigates the potential of a software tool based on Latent Semantic Analysis (LSA; Landauer, McNamara, Dennis, & Kintsch, 2007) to automatically evaluate complex German texts. A sample of N = 94 German university students provided written answers to questions that involved a high amount of analytical reasoning and evaluation.…

This study examined the influence of Process Approach on English as second language Students' performances in essay writing. The purpose was to determine how far this current global approach could be of assistance to the writing skill development of these bilingual speakers of English language. The study employed the pre-test post-test control…

Background: This article reports a study into the double marking of Liberal Studies in Hong Kong. This is now a compulsory subject in Hong Kong's Years 10-12 curriculum which, when first examined in the new Hong Kong Diploma of Secondary Education in 2012, will increase its candidature from its current 3,300 to 80,000. Aims: To examine the…