While knowing what to expect is important, it is equally important to know when to expect it and to respond accordingly. This is apparent even in simple Pavlovian training situations in which animals learn to respond more strongly closer to reward delivery. Here we report that the nucleus accumbens core, an area well-positioned to represent…

Heterotrimeric G(o) is an abundant brain protein required for negatively reinforced short-term associative olfactory memory in "Drosophila". G(o) is the only known substrate of the S1 subunit of pertussis toxin (PTX) in fly, and acute expression of PTX within the mushroom body neurons (MB) induces a reversible deficit in associative olfactory…

Associative conditioning in "Drosophila melanogaster" has been well documented for several decades. However, most studies report only simple associations of conditioned stimuli (CS, e.g., odor) with unconditioned stimuli (US, e.g., electric shock) to measure learning or establish memory. Here we describe a straightforward second-order conditioning…

We investigated the involvement of PKA and PKC signaling in a negatively reinforced operant learning paradigm in "Aplysia", learning that food is inedible (LFI). In vivo injection of PKA or PKC inhibitors blocked long-term LFI memory formation. Moreover, a persistent phase of PKA activity, although not PKC activity, was necessary for long-term…

The evidence for a role of the striatum in the acquisition of uncued instrumental responding is ambiguous. It has been shown that post-session infusions of anisomycin into the core of the nucleus accumbens (NAcc) impaired instrumental acquisition, but pre-training lesions of the NAcc suggest that it is not necessary. Recently, we demonstrated that…

Rats were trained to run a straight-alley maze for an oral cocaine or sucrose vehicle solution reward, followed by either response or latent extinction training procedures that engage neuroanatomically dissociable "habit" and "cognitive" memory systems, respectively. In the response extinction condition, rats performed a runway approach response…

The ventral tegmental area (VTA) and substantia nigra pars compacta (SNc) may provide modulatory signals that, respectively, influence hippocampal (HPC)- and striatal-dependent memory. Electrophysiological studies investigating neural correlates of learning and memory of dopamine (DA) neurons during classical conditioning tasks have found DA…

Neuronal activity regulated pentraxin (Narp) is a secreted protein that regulates [alpha]-amino-3-hydroxyl-5-methyl-4-isoxazole-propionate receptors (AMPAR) aggregation and synaptogenesis. Mapping of Narp-positive neurons in brain has revealed it is prominently expressed in several limbic system projection pathways. Consistent with this…

We have investigated the neurochemical mechanisms of memory reconsolidation and, in particular, the functional requirement for intracellular mechanisms initiated by [beta]-adrenergic signaling. We show that propranolol, given in conjunction with a memory reactivation session, can specifically disrupt the conditioned reinforcing properties of a…

Extinction of fear requires learning that anticipated aversive events no longer occur. Animal models reveal that sustained phosphorylation of the extracellular signal-regulated kinase (Erk) in hippocampal CA1 neurons plays an important role in this process. However, the key signals triggering and regulating the activity of Erk are not known. By…

Reinforcement learning theories postulate that actions are chosen to maximize a long-term sum of positive outcomes based on value functions, which are subjective estimates of future rewards. In simple reinforcement learning algorithms, value functions are updated only by trial-and-error, whereas they are updated according to the decision-maker's…

The present study investigated the extent to which fear generalization in humans is determined by the amount of fear intensity in nonconditioned stimuli relative to a perceptually similar conditioned stimulus. Stimuli consisted of graded emotionally expressive faces of the same identity morphed between neutral and fearful endpoints. Two…

Memory systems are known to be influenced by feedback and error processing, but it is not well known what aspects of outcome contingencies are related to different memory systems. Here we use the Rescorla-Wagner model to estimate prediction errors in an fMRI study of stimulus-outcome association learning. The conditional probabilities of outcomes…

Pavlovian stimuli previously paired with food can markedly elevate the rate of food-reinforced instrumental responding. This effect, termed Pavlovian-instrumental transfer (PIT), depends both on general activating and specific cueing properties of Pavlovian stimuli. Recent evidence suggests that the general activating properties of Pavlovian…

Contexts and discrete cues associated with drug-taking are often responsible for relapse among addicts. Animal models have shown that interference with the reconsolidation of drug-cue memories can reduce seeking of drugs or drug-paired stimuli. One such model is conditioned place preference (CPP) in which an animal is trained to associate a…