This real-data-guided simulation study systematically evaluated the decision accuracy of complex decision rules combining multiple tests within different realistic curricula. Specifically, complex decision rules combining conjunctive aspects and compensatory aspects were evaluated. A conjunctive aspect requires a minimum level of performance,…

While young people are generally better educated today than ever before, recent graduates tend to lack practical skills -- especially digital skills. Certification programs offer one effective way to address this digital skills gap. They give learners a way to gain the skills they need to compete, and also to demonstrate credibly that they possess…

Open online distance learning in higher education has quickly gained popularity, expanded, and evolved, with Massive Open Online Courses (MOOCs) as the most recent development. New web technologies allow for scalable ways to deliver video lecture content, implement social forums and track student progress in MOOCs. However, we remain limited in…

In the discussion of mean square difference (MSD) and standard error of measurement (SEM), Barchard (2012) concluded that the MSD between 2 sets of test scores is greater than 2(SEM)[superscript 2] and SEM underestimates the score difference between 2 tests when the 2 tests are not parallel. This conclusion has limitations for 2 reasons. First,…

Because it is often impractical or impossible to obtain school transcripts or records on subjects, many researchers rely on college students to accurately self-report their academic record as part of their data collection procedures. The purpose of this study is to investigate the validity and reliability of student self-reported academic…

The "Special Ability Selection Examination" (SASE), which is used to select appropriate students for the music education departments of educational faculties in Turkey, has many subsections and must evaluate highly competitive cohorts of students according to a broad range of criteria. The test consists of three subsections, with a large…

This paper presents an argument against traditional evaluation of students by examination and offers proposals for reform of the present system. Strengths and weaknesses of evaluation methods such as objective tests, use of the year's work, essay examinations, practical examinations, and oral examinations are discussed as well as the need for…

A good test used to measure student's knowledge and abilities is useful educationally even if it does not teach directly. Article based on address at American Society for Engineering Education's North Midwest Section Effective Teaching Institute, March 1969. (IR)

Discusses two papers on university test validity and presents rational standards for researchers working on test validity. (PG)

The purpose of the present study was to norm and validate the College-Level Examination Program (CLEP) Introductory Calculus Subject Examination for two University of Illinois calculus courses, Math 120 and Math 135. It was of interest to determine if this examination could be used as a calculus placement and proficiency examination for new…

If traditional examinations were eliminated, would course work still show the same superior students? (Author/PG)

The Test of Understanding of College Economics, the Test of Economic Literacy for senior high students, and the Basic Economics Test for students in grades 4-6 provide reasonably good measures of economic understanding. The tests' technical features--reliability, validity, norms, and item statistics--are critiqued. (RM)

This paper involves an application of generalizability theory in assessing the dependability of a foreign language placement exam. The French Cloze test was administered to students within five levels of French classes and the results were scored by four different raters. Three specific generalizability coefficients are discussed along with…

Multiple-choice mathematics tests and other measures of achievement in a mathematics course for engineering students were compared. Although the results were highly correlated, there were some discrepancies. (SD)