"What-Where-Which" Episodic Retrieval Requires Conscious Recollection and Is Promoted by Semantic Knowledge

Episodic memory is defined as the conscious retrieval of specific past events. Whether accurate episodic retrieval requires a recollective experience or if a feeling of knowing is sufficient remains unresolved. We recently devised an ecological approach to investigate the controlled cued-retrieval of episodes composed of unnamable odors (What) located spatially (Where) within a visual context (Which context). By combining the Remember/Know procedure with our laboratory-ecological approach in an original way, the present study demonstrated that the accurate odor-evoked retrieval of complex and multimodal episodes overwhelmingly required conscious recollection. A feeling of knowing, even when associated with a high level of confidence, was not sufficient to generate accurate episodic retrieval. Interestingly, we demonstrated that the recollection of accurate episodic memories was promoted by odor retrieval-cue familiarity and describability. In conclusion, our study suggested that semantic knowledge about retrieval-cues increased the recollection which is the state of awareness required for the accurate retrieval of complex episodic memories.     

The neural substrates of memory suppression: a FMRI exploration of directed forgetting

The directed forgetting paradigm is frequently used to determine the ability to voluntarily suppress information. However, little is known about brain areas associated with information to forget. The present study used functional magnetic resonance imaging to determine brain activity during the encoding and retrieval phases of an item-method directed forgetting recognition task with neutral verbal material in order to apprehend all processing stages that information to forget and to remember undergoes. We hypothesized that regions supporting few selective processes, namely recollection and familiarity memory processes, working memory, inhibitory and selection processes should be differentially activated during the processing of to-be-remembered and to-be-forgotten items. Successful encoding and retrieval of items to remember engaged the entorhinal cortex, the hippocampus, the anterior medial prefrontal cortex, the left inferior parietal cortex, the posterior cingulate cortex and the precuneus; this set of regions is well known to support deep and associative encoding and retrieval processes in episodic memory. For items to forget, encoding was associated with higher activation in the right middle frontal and posterior parietal cortex, regions known to intervene in attentional control. Items to forget but nevertheless correctly recognized at retrieval yielded activation in the dorsomedial thalamus, associated with familiarity-based memory processes and in the posterior intraparietal sulcus and the anterior cingulate cortex, involved in attentional processes.     

Competitive Semantic Memory Retrieval: Temporal Dynamics Revealed by Event-Related Potentials

Memories compete for retrieval when they are related to a common retrieval cue. Previous research has shown that retrieval of a target memory may lead to subsequent retrieval-induced forgetting (RIF) of currently irrelevant competing memories. In the present study, we investigated the time course of competitive semantic retrieval and examined the neurocognitive mechanisms underlying RIF. We contrasted two theoretical accounts of RIF by examining a critical aspect of this memory phenomenon, namely the extent to which it depends on successful retrieval of the target memory. Participants first studied category-exemplar word-pairs (e.g. Fruit—Apple). Next, we recorded electrophysiological measures of brain activity while the participants performed a competitive semantic cued-recall task. In this task, the participants were provided with the studied categories but they were instructed to retrieve other unstudied exemplars (e.g. Fruit—Ma__?). We investigated the event-related potential (ERP) correlates of retrieval success by comparing ERPs from successful and failed retrieval trials. To isolate the ERP correlates of continuous retrieval attempts from the ERP correlates of retrieval success, we included an impossible retrieval condition, with incompletable word-stem cues (Drinks—Wy__) and compared it with a non-retrieval presentation baseline condition (Occupation—Dentist). The participants’ memory for all the studied exemplars was tested in the final phase of the experiment. Taken together, the behavioural results suggest that RIF is independent of target retrieval. Beyond investigating the mechanisms underlying RIF, the present study also elucidates the temporal dynamics of semantic cued-recall by isolating the ERP correlates of retrieval attempt and retrieval success. The ERP results revealed that retrieval attempt is reflected in a late posterior negativity, possibly indicating construction of candidates for completing the word-stem cue and retrieval monitoring whereas retrieval success was reflected in an anterior positive slow wave.     

Processing Chinese Relative Clauses: Evidence for the Subject-Relative Advantage

A general fact about language is that subject relative clauses are easier to process than object relative clauses. Recently, several self-paced reading studies have presented surprising evidence that object relatives in Chinese are easier to process than subject relatives. We carried out three self-paced reading experiments that attempted to replicate these results. Two of our three studies found a subject-relative preference, and the third study found an object-relative advantage. Using a random effects bayesian meta-analysis of fifteen studies (including our own), we show that the overall current evidence for the subject-relative advantage is quite strong (approximate posterior probability of a subject-relative advantage given the data: 78–80%). We argue that retrieval/integration based accounts would have difficulty explaining all three experimental results. These findings are important because they narrow the theoretical space by limiting the role of an important class of explanation—retrieval/integration cost—at least for relative clause processing in Chinese.     

Attention Enhances the Retrieval and Stability of Visuospatial and Olfactory Representations in the Dorsal Hippocampus

A key question in the analysis of hippocampal memory relates to how attention modulates the encoding and long-term retrieval of spatial and nonspatial representations in this region. To address this question, we recorded from single cells over a period of 5 days in the CA1 region of the dorsal hippocampus while mice acquired one of two goal-oriented tasks. These tasks required the animals to find a hidden food reward by attending to either the visuospatial environment or a particular odor presented in shifting spatial locations. Attention to the visuospatial environment increased the stability of visuospatial representations and phase locking to gamma oscillations—a form of neuronal synchronization thought to underlie the attentional mechanism necessary for processing task-relevant information. Attention to a spatially shifting olfactory cue compromised the stability of place fields and increased the stability of reward-associated odor representations, which were most consistently retrieved during periods of sniffing and digging when animals were restricted to the cup locations. Together, these results suggest that attention selectively modulates the encoding and retrieval of hippocampal representations by enhancing physiological responses to task-relevant information.     

Hippocampus Is Place of Interaction between Unconscious and Conscious Memories

Recent evidence suggests that humans can form and later retrieve new semantic relations unconsciously by way of hippocampus—the key structure also recruited for conscious relational (episodic) memory. If the hippocampus subserves both conscious and unconscious relational encoding/retrieval, one would expect the hippocampus to be place of unconscious-conscious interactions during memory retrieval. We tested this hypothesis in an fMRI experiment probing the interaction between the unconscious and conscious retrieval of face-associated information. For the establishment of unconscious relational memories, we presented subliminal (masked) combinations of unfamiliar faces and written occupations (“actor” or “politician”). At test, we presented the former subliminal faces, but now supraliminally, as cues for the reactivation of the unconsciously associated occupations. We hypothesized that unconscious reactivation of the associated occupation—actor or politician—would facilitate or inhibit the subsequent conscious retrieval of a celebrity’s occupation, which was also actor or politician. Depending on whether the reactivated unconscious occupation was congruent or incongruent to the celebrity’s occupation, we expected either quicker or delayed conscious retrieval process. Conscious retrieval was quicker in the congruent relative to a neutral baseline condition but not delayed in the incongruent condition. fMRI data collected during subliminal face-occupation encoding confirmed previous evidence that the hippocampus was interacting with neocortical storage sites of semantic knowledge to support relational encoding. fMRI data collected at test revealed that the facilitated conscious retrieval was paralleled by deactivations in the hippocampus and neocortical storage sites of semantic knowledge. We assume that the unconscious reactivation has pre-activated overlapping relational representations in the hippocampus reducing the neural effort for conscious retrieval. This finding supports the notion of synergistic interactions between conscious and unconscious relational memories in a common, cohesive hippocampal-neocortical memory space.     

Key Features of Human Episodic Recollection in the Cross-Episode Retrieval of Rat Hippocampus Representations of Space

Neurophysiological studies focus on memory retrieval as a reproduction of what was experienced and have established that neural discharge is replayed to express memory. However, cognitive psychology has established that recollection is not a verbatim replay of stored information. Recollection is constructive, the product of memory retrieval cues, the information stored in memory, and the subject''s state of mind. We discovered key features of constructive recollection embedded in the rat CA1 ensemble discharge during an active avoidance task. Rats learned two task variants, one with the arena stable, the other with it rotating; each variant defined a distinct behavioral episode. During the rotating episode, the ensemble discharge of CA1 principal neurons was dynamically organized to concurrently represent space in two distinct codes. The code for spatial reference frame switched rapidly between representing the rat''s current location in either the stationary spatial frame of the room or the rotating frame of the arena. The code for task variant switched less frequently between a representation of the current rotating episode and the stable episode from the rat''s past. The characteristics and interplay of these two hippocampal codes revealed three key properties of constructive recollection. (1) Although the ensemble representations of the stable and rotating episodes were distinct, ensemble discharge during rotation occasionally resembled the stable condition, demonstrating cross-episode retrieval of the representation of the remote, stable episode. (2) This cross-episode retrieval at the level of the code for task variant was more likely when the rotating arena was about to match its orientation in the stable episode. (3) The likelihood of cross-episode retrieval was influenced by preretrieval information that was signaled at the level of the code for spatial reference frame. Thus key features of episodic recollection manifest in rat hippocampal representations of space.     

Serial Position Markers in Space: Visuospatial Priming of Serial Order Working Memory Retrieval

Most general theories on serial order working memory (WM) assume the existence of position markers that are bound to the to-be-remembered items to keep track of the serial order. So far, the exact cognitive/neural characteristics of these markers have remained largely underspecified, while direct empirical evidence for their existence is mostly lacking. In the current study we demonstrate that retrieval from verbal serial order WM can be facilitated or hindered by spatial cuing: begin elements of a verbal WM sequence are retrieved faster after cuing the left side of space, while end elements are retrieved faster after cuing the right side of space. In direct complement to our previous work—where we showed the reversed impact of WM retrieval on spatial processing—we argue that the current findings provide us with a crucial piece of evidence suggesting a direct and functional involvement of space in verbal serial order WM. We outline the idea that serial order in verbal WM is coded within a spatial coordinate system with spatial attention being involved when searching through WM, and we discuss how this account can explain several hallmark observations related to serial order WM.     

Retrieval accuracy, statistical significance and compositional similarity in protein sequence database searches

Protein sequence database search programs may be evaluated both for their retrieval accuracy—the ability to separate meaningful from chance similarities—and for the accuracy of their statistical assessments of reported alignments. However, methods for improving statistical accuracy can degrade retrieval accuracy by discarding compositional evidence of sequence relatedness. This evidence may be preserved by combining essentially independent measures of alignment and compositional similarity into a unified measure of sequence similarity. A version of the BLAST protein database search program, modified to employ this new measure, outperforms the baseline program in both retrieval and statistical accuracy on ASTRAL, a SCOP-based test set.     

Retrieval Intention Modulates the Effects of Directed Forgetting Instructions on Recollection

The neurocognitive basis of memory retrieval is often examined by investigating brain potential old/new effects, which are differences in brain activity between successfully remembered repeated stimuli and correctly rejected new stimuli in a recognition test. In this study, we combined analyses of old/new effects for words with an item-method directed-forgetting manipulation in order to isolate differences between the retrieval processes elicited by words that participants were initially instructed to commit to memory and those that participants were initially instructed to forget. We compared old/new effects elicited by to-be-forgotten (TBF) words with those elicited by to-be-remembered (TBR) words in both an explicit-memory test (a recognition test) and an implicit-memory test (a lexical-decision test). Behavioral results showed clear directed forgetting effects in the recognition test, but not in the lexical decision test. Mirroring the behavioral findings, analyses of brain potentials showed evidence of directed forgetting only in the recognition test. In this test, potentials from 450–650 ms (P600 old/new effects) were more positive for TBR relative to TBF words. By contrast, P600 effects evident during the lexical-decision test did not differ in magnitude between TBR and TBF items. When taken in the context of prior studies that have linked similar parietal old/new effects to the recollection of episodic information, these data suggest that directed-forgetting effects manifest primarily in greater episodic retrieval by TBR than TBF items, and that retrieval intention may be important for these directed-forgetting effects to occur.     

The neural basis of episodic memory: evidence from functional neuroimaging

We review some of our recent research using functional neuroimaging to investigate neural activity supporting the encoding and retrieval of episodic memories, that is, memories for unique events. Findings from studies of encoding indicate that, at the cortical level, the regions responsible for the effective encoding of a stimulus event as an episodic memory include some of the regions that are also engaged to process the event 'online'. Thus, it appears that there is no single cortical site or circuit responsible for episodic encoding. The results of retrieval studies indicate that successful recollection of episodic information is associated with activation of lateral parietal cortex, along with more variable patterns of activity in dorsolateral and anterior prefrontal cortex. Whereas parietal regions may play a part in the representation of retrieved information, prefrontal areas appear to support processes that act on the products of retrieval to align behaviour with the demands of the retrieval task.     

A Dataset of Metaphors from the Italian Literature: Exploring Psycholinguistic Variables and the Role of Context

Defining the specific role of the factors that affect metaphor processing is a fundamental step for fully understanding figurative language comprehension, either in discourse and conversation or in reading poems and novels. This study extends the currently available materials on everyday metaphorical expressions by providing the first dataset of metaphors extracted from literary texts and scored for the major psycholinguistic variables, considering also the effect of context. A set of 115 Italian literary metaphors presented in isolation (Experiment 1) and a subset of 65 literary metaphors embedded in their original texts (Experiment 2) were rated on several dimensions (word and phrase frequency, readability, cloze probability, familiarity, concreteness, difficulty and meaningfulness). Overall, literary metaphors scored around medium-low values on all dimensions in both experiments. Collected data were subjected to correlation analysis, which showed the presence of a strong cluster of variables—mainly familiarity, difficulty, and meaningfulness—when literary metaphor were presented in isolation. A weaker cluster was observed when literary metaphors were presented in the original contexts, with familiarity no longer correlating with meaningfulness. Context manipulation influenced familiarity, concreteness and difficulty ratings, which were lower in context than out of context, while meaningfulness increased. Throughout the different dimensions, the literary context seems to promote a global interpretative activity that enhances the open-endedness of the metaphor as a semantic structure constantly open to all possible interpretations intended by the author and driven by the text. This dataset will be useful for the design of future experimental studies both on literary metaphor and on the role of context in figurative meaning, combining ecological validity and aesthetic aspects of language.     

Dominance of Objects over Context in a Mediotemporal Lobe Model of Schizophrenia

Background

A large body of evidence suggests impaired context processing in schizophrenia. Here we propose that this impairment arises from defective integration of mediotemporal ‘what’ and ‘where’ routes, carrying object and spatial information to the hippocampus.

Methodology and Findings

We have previously shown, in a mediotemporal lobe (MTL) model, that the abnormal connectivity between MTL regions observed in schizophrenia can explain the episodic memory deficits associated with the disorder. Here we show that the same neuropathology leads to several context processing deficits observed in patients with schizophrenia: 1) failure to choose subordinate stimuli over dominant ones when the former fit the context, 2) decreased contextual constraints in memory retrieval, as reflected in increased false alarm rates and 3) impaired retrieval of contextual information in source monitoring. Model analyses show that these deficits occur because the ‘schizophrenic MTL’ forms fragmented episodic representations, in which objects are overrepresented at the expense of spatial contextual information.

Conclusions and Significance

These findings highlight the importance of MTL neuropathology in schizophrenia, demonstrating that it may underlie a broad spectrum of deficits, including context processing and memory impairments. It is argued that these processing deficits may contribute to central schizophrenia symptoms such as contextually inappropriate behavior, associative abnormalities, conversational drift, concreteness and delusions.     

Olfactory learning and behaviour are ‘insulated’ against visual processing in larval Drosophila

We investigate the organization of behaviour across sensory modalities, using larval Drosophila melanogaster. We ask whether olfactory learning and behaviour are affected by visual processing. We find that: (1) Visual choice does not affect concomitant odour choice. (2) Visual context does not influence odour learning, nor do changes of visual context between training and test affect retrieval of odour memory. (3) Larvae cannot solve a biconditional discrimination task, despite generally permissive conditions. In this task, larvae are required to establish conditional associations: in light, one odour is rewarded and the other one is not, whereas in dark the opposite contingency is established. After such training, choice between the two odours is equal under light and dark testing conditions, suggesting that larvae do not establish odour memories specifically for one visual context only. Together, these data suggest that, in larval Drosophila, olfactory learning and behaviour are ‘insulated’ against visual processing.     

Affective Video Retrieval: Violence Detection in Hollywood Movies by Large-Scale Segmental Feature Extraction

Without doubt general video and sound, as found in large multimedia archives, carry emotional information. Thus, audio and video retrieval by certain emotional categories or dimensions could play a central role for tomorrow''s intelligent systems, enabling search for movies with a particular mood, computer aided scene and sound design in order to elicit certain emotions in the audience, etc. Yet, the lion''s share of research in affective computing is exclusively focusing on signals conveyed by humans, such as affective speech. Uniting the fields of multimedia retrieval and affective computing is believed to lend to a multiplicity of interesting retrieval applications, and at the same time to benefit affective computing research, by moving its methodology “out of the lab” to real-world, diverse data. In this contribution, we address the problem of finding “disturbing” scenes in movies, a scenario that is highly relevant for computer-aided parental guidance. We apply large-scale segmental feature extraction combined with audio-visual classification to the particular task of detecting violence. Our system performs fully data-driven analysis including automatic segmentation. We evaluate the system in terms of mean average precision (MAP) on the official data set of the MediaEval 2012 evaluation campaign''s Affect Task, which consists of 18 original Hollywood movies, achieving up to .398 MAP on unseen test data in full realism. An in-depth analysis of the worth of individual features with respect to the target class and the system errors is carried out and reveals the importance of peak-related audio feature extraction and low-level histogram-based video analysis.     

Rational inattention and tonic dopamine

Slow-timescale (tonic) changes in dopamine (DA) contribute to a wide variety of processes in reinforcement learning, interval timing, and other domains. Furthermore, changes in tonic DA exert distinct effects depending on when they occur (e.g., during learning vs. performance) and what task the subject is performing (e.g., operant vs. classical conditioning). Two influential theories of tonic DA—the average reward theory and the Bayesian theory in which DA controls precision—have each been successful at explaining a subset of empirical findings. But how the same DA signal performs two seemingly distinct functions without creating crosstalk is not well understood. Here we reconcile the two theories under the unifying framework of ‘rational inattention,’ which (1) conceptually links average reward and precision, (2) outlines how DA manipulations affect this relationship, and in so doing, (3) captures new empirical phenomena. In brief, rational inattention asserts that agents can increase their precision in a task (and thus improve their performance) by paying a cognitive cost. Crucially, whether this cost is worth paying depends on average reward availability, reported by DA. The monotonic relationship between average reward and precision means that the DA signal contains the information necessary to retrieve the precision. When this information is needed after the task is performed, as presumed by Bayesian inference, acute manipulations of DA will bias behavior in predictable ways. We show how this framework reconciles a remarkably large collection of experimental findings. In reinforcement learning, the rational inattention framework predicts that learning from positive and negative feedback should be enhanced in high and low DA states, respectively, and that DA should tip the exploration-exploitation balance toward exploitation. In interval timing, this framework predicts that DA should increase the speed of the internal clock and decrease the extent of interference by other temporal stimuli during temporal reproduction (the central tendency effect). Finally, rational inattention makes the new predictions that these effects should be critically dependent on the controllability of rewards, that post-reward delays in intertemporal choice tasks should be underestimated, and that average reward manipulations should affect the speed of the clock—thus capturing empirical findings that are unexplained by either theory alone. Our results suggest that a common computational repertoire may underlie the seemingly heterogeneous roles of DA.     

Social Priming Improves Cognitive Control in Elderly Adults—Evidence from the Simon Task

We examined whether social priming of cognitive states affects the inhibitory process in elderly adults, as aging is related to deficits in inhibitory control. Forty-eight elderly adults and 45 young adults were assigned to three groups and performed a cognitive control task (Simon task), which was followed by 3 different manipulations of social priming (i.e., thinking about an 82 year-old person): 1) negative—characterized by poor cognitive abilities, 2) neutral—characterized by acts irrelevant to cognitive abilities, and 3) positive—excellent cognitive abilities. After the manipulation, the Simon task was performed again. Results showed improvement in cognitive control effects in seniors after the positive manipulation, indicated by a significant decrease in the magnitude of the Simon and interference effects, but not after the neutral and negative manipulations. Furthermore, a healthy pattern of sequential effect (Gratton) that was absent before the manipulation in all 3 groups appeared after the positive manipulation. Namely, the Simon effect was only present after congruent but not after incongruent trials for the positive manipulation group. No influence of manipulations was found in young adults. These meaningful results were replicated in a second experiment and suggest a decrease in conflict interference resulting from positive cognitive state priming. Our study provides evidence that an implicit social concept of a positive cognitive condition in old age can affect the control process of the elderly and improve cognitive abilities.