In particular research domains, the randomized control trial (RCT) is considered to be the only means for obtaining reliable estimates of the true impact of an intervention. However, an RCT design would often not be considered ethical, politically feasible, or appropriate for evaluating the impact of many policy, programme, or structural changes…

Despite the increase in federal tiered evidence initiatives that require the use of rigorous evaluation designs, such as randomized experiments, there has been limited guidance in the evaluation literature on practical strategies to implement such studies successfully. This paper provides lessons learned in executing experiments in applied…

Graph representations underlie many modern computer applications, capturing the structure of such diverse networks as the Internet, personal associations, roads, sensors, and metabolic pathways. While the static structure of graphs is a well-explored field, a new emphasis is being placed on understanding and representing the way these networks…

This paper reviews the use of multiple trials, defined as multiple sites or multiple arms in a single evaluation and replications, in evaluating social programs. After defining key terms, the paper discusses the rationales for conducting multiple trials, which include increasing sample size to increase statistical power; identifying the most…

Over the past decade an increasing number of studies across a range of domains have shown that the repeated performance of approach and avoidance (AA) actions in response to a stimulus leads to changes in the evaluation of that stimulus. The dominant (motivational-systems) account in this area claims that these effects are caused by a rewiring of…

An animated concept map represents verbal information in a node-link diagram that changes over time. The goals of the experiment were to evaluate the instructional effects of presenting an animated concept map concurrently with semantically equivalent spoken narration. The study used a 2 x 2 factorial design in which an animation factor (animated…

We argue that the nativist-empiricist debate in developmental psychology is distorted, both theoretically and methodologically, by a shared framework of assumptions concerning the nature of representation. In particular, both sides of the debate assume models of representation that make the emergence of representation impossible. This, in turn,…

Research has suggested that a daily multiple-stimulus-without-replacement (MSWO) preference assessment may be more sensitive to changes in preference than other assessment formats, thereby resulting in greater correspondence with reinforcer efficacy over time (DeLeon et al., 2001). However, most prior studies have measured reinforcer efficacy…

Previous research yielded conflicting results about when children can accurately assess their epistemic states in different hiding tasks. In Experiment 1, ninety-two 3- to 7-year-olds were either shown which object was hidden inside a box, were totally ignorant about what it could be, or were presented with two objects one of which was being put…

Identifying the skills that determine the success or failure to exercises and question items is a difficult task. Multiple skills may be involved at various degree of importance, and skills may overlap and correlate. In an effort towards the goal of finding the skills behind a set of items, we investigate two techniques to determine the number of…

Often, in the case of experimental evaluations of multifaceted interventions, researchers and policymakers alike are interested in asking not only whether a given intervention had an effect but also why. They seek answers to questions such as: What features of the intervention led to the impacts that we have observed, or what was the causal…

There are important research issues surrounding the best methods for evaluating creativity of animation. This study proposed an approach to evaluate the creativity of short animation by adopting Linkography. This article reported the results of two experiments performed to test this approach. In study 1, participants identified as impressive a set…

For many designers, freehand sketching is the primary tool for conceptualization in the early stage of the design process. However, current education on concept presentation techniques rarely emphasizes the construction of the most fundamental spatial unit, the cube. Incorrect construction of spatial units leads to disproportions that deviate from…

In three experiments, we evaluated remembering and intentional forgetting of attitude statements that were either congruent or incongruent with participants' own political attitudes. In Experiment 1, significant directed forgetting was obtained for incongruent statements, but not for congruent statements. In addition, in the remember group, recall…

Two experiments were conducted investigating the role of visual sequential memory skill in the word recognition efficiency of undergraduate university students. Word recognition was assessed in a lexical decision task using regularly and strangely spelt words, and nonwords that were either standard orthographically legal strings or items made from…