A synergetic model for the verbal transformation effect

We describe a nonlinear dynamical model based on synergetics for the auditory perceptual illusion known as the verbal transformation effect. The model is an extension of a synergetic model of perceptual oscillations of visual ambiguous figures. The main extension is connected to the number of reported alternative phonemic structures, which is typically much greater than the two or three alternatives usually reported in experiments with visual ambiguous figures. The properties of the model, which are derived using basic psychophysical principles, are presented and evaluated on the basis of the fit to earlier empirical work. It will be shown that there is very good agreement between the empirically observed properties of the verbal transformation effect and the properties detected by the model. Received: 19 February 1997 / Accepted in revised form: 27 May 1997     

Functional brain networks underlying perceptual switching: auditory streaming and verbal transformations

Recent studies have shown that auditory scene analysis involves distributed neural sites below, in, and beyond the auditory cortex (AC). However, it remains unclear what role each site plays and how they interact in the formation and selection of auditory percepts. We addressed this issue through perceptual multistability phenomena, namely, spontaneous perceptual switching in auditory streaming (AS) for a sequence of repeated triplet tones, and perceptual changes for a repeated word, known as verbal transformations (VTs). An event-related fMRI analysis revealed brain activity timelocked to perceptual switching in the cerebellum for AS, in frontal areas for VT, and the AC and thalamus for both. The results suggest that motor-based prediction, produced by neural networks outside the auditory system, plays essential roles in the segmentation of acoustic sequences both in AS and VT. The frequency of perceptual switching was determined by a balance between the activation of two sites, which are proposed to be involved in exploring novel perceptual organization and stabilizing current perceptual organization. The effect of the gene polymorphism of catechol-O-methyltransferase (COMT) on individual variations in switching frequency suggests that the balance of exploration and stabilization is modulated by catecholamines such as dopamine and noradrenalin. These mechanisms would support the noteworthy flexibility of auditory scene analysis.     

Modelling the Emergence and Dynamics of Perceptual Organisation in Auditory Streaming

Many sound sources can only be recognised from the pattern of sounds they emit, and not from the individual sound events that make up their emission sequences. Auditory scene analysis addresses the difficult task of interpreting the sound world in terms of an unknown number of discrete sound sources (causes) with possibly overlapping signals, and therefore of associating each event with the appropriate source. There are potentially many different ways in which incoming events can be assigned to different causes, which means that the auditory system has to choose between them. This problem has been studied for many years using the auditory streaming paradigm, and recently it has become apparent that instead of making one fixed perceptual decision, given sufficient time, auditory perception switches back and forth between the alternatives—a phenomenon known as perceptual bi- or multi-stability. We propose a new model of auditory scene analysis at the core of which is a process that seeks to discover predictable patterns in the ongoing sound sequence. Representations of predictable fragments are created on the fly, and are maintained, strengthened or weakened on the basis of their predictive success, and conflict with other representations. Auditory perceptual organisation emerges spontaneously from the nature of the competition between these representations. We present detailed comparisons between the model simulations and data from an auditory streaming experiment, and show that the model accounts for many important findings, including: the emergence of, and switching between, alternative organisations; the influence of stimulus parameters on perceptual dominance, switching rate and perceptual phase durations; and the build-up of auditory streaming. The principal contribution of the model is to show that a two-stage process of pattern discovery and competition between incompatible patterns can account for both the contents (perceptual organisations) and the dynamics of human perception in auditory streaming.     

Representational switching by dynamical reorganization of attractor structure in a network model of the prefrontal cortex

The prefrontal cortex (PFC) plays a crucial role in flexible cognitive behavior by representing task relevant information with its working memory. The working memory with sustained neural activity is described as a neural dynamical system composed of multiple attractors, each attractor of which corresponds to an active state of a cell assembly, representing a fragment of information. Recent studies have revealed that the PFC not only represents multiple sets of information but also switches multiple representations and transforms a set of information to another set depending on a given task context. This representational switching between different sets of information is possibly generated endogenously by flexible network dynamics but details of underlying mechanisms are unclear. Here we propose a dynamically reorganizable attractor network model based on certain internal changes in synaptic connectivity, or short-term plasticity. We construct a network model based on a spiking neuron model with dynamical synapses, which can qualitatively reproduce experimentally demonstrated representational switching in the PFC when a monkey was performing a goal-oriented action-planning task. The model holds multiple sets of information that are required for action planning before and after representational switching by reconfiguration of functional cell assemblies. Furthermore, we analyzed population dynamics of this model with a mean field model and show that the changes in cell assemblies' configuration correspond to those in attractor structure that can be viewed as a bifurcation process of the dynamical system. This dynamical reorganization of a neural network could be a key to uncovering the mechanism of flexible information processing in the PFC.     

Neurocognitive systems related to real-world prospective memory

Background

Prospective memory (PM) denotes the ability to remember to perform actions in the future. It has been argued that standard laboratory paradigms fail to capture core aspects of PM.

Methodology/Principal Findings

We combined functional MRI, virtual reality, eye-tracking and verbal reports to explore the dynamic allocation of neurocognitive processes during a naturalistic PM task where individuals performed errands in a realistic model of their residential town. Based on eye movement data and verbal reports, we modeled PM as an iterative loop of five sustained and transient phases: intention maintenance before target detection (TD), TD, intention maintenance after TD, action, and switching, the latter representing the activation of a new intention in mind. The fMRI analyses revealed continuous engagement of a top-down fronto-parietal network throughout the entire task, likely subserving goal maintenance in mind. In addition, a shift was observed from a perceptual (occipital) system while searching for places to go, to a mnemonic (temporo-parietal, fronto-hippocampal) system for remembering what actions to perform after TD. Updating of the top-down fronto-parietal network occurred at both TD and switching, the latter likely also being characterized by frontopolar activity.

Conclusion/Significance

Taken together, these findings show how brain systems complementary interact during real-world PM, and support a more complete model of PM that can be applied to naturalistic PM tasks and that we named PROspective MEmory DYnamic (PROMEDY) model because of its dynamics on both multi-phase iteration and the interactions of distinct neurocognitive networks.     

Perceptual switch rates with ambiguous structure-from-motion figures in bipolar disorder

Slowing of the rate at which a rivalrous percept switches from one configuration to another has been suggested as a potential trait marker for bipolar disorder. We measured perceptual alternations for a bistable, rotating, structure-from-motion cylinder in bipolar and control participants. In a control task, binocular depth rendered the direction of cylinder rotation unambiguous to monitor participants' performance and attention during the experimental task. A particular direction of rotation was perceptually stable, on average, for 33.5s in participants without psychiatric diagnosis. Euthymic, bipolar participants showed a slightly slower rate of switching between the two percepts (percept duration 42.3s). Under a parametric analysis of the best-fitting model for individual participants, this difference was statistically significant. However, the variability within groups was high, so this difference in average switch rates was not big enough to serve as a trait marker for bipolar disorder. We also found that low-level visual capacities, such as stereo threshold, influence perceptual switch rates. We suggest that there is no single brain location responsible for perceptual switching in all different ambiguous figures and that perceptual switching is generated by the actions of local cortical circuitry.     

The effects of task and saliency on latencies for colour and motion processing

In human visual perception, there is evidence that different visual attributes, such as colour, form and motion, have different neural-processing latencies. Specifically, recent studies have suggested that colour changes are processed faster than motion changes. We propose that the processing latencies should not be considered as fixed quantities for different attributes, but instead depend upon attribute salience and the observer's task. We asked observers to respond to high- and low-salience colour and motion changes in three different tasks. The tasks varied from having a strong motor component to having a strong perceptual component. Increasing salience led to shorter processing times in all three tasks. We also found an interaction between task and attribute: motion was processed more quickly in reaction-time tasks, whereas colour was processed more quickly in more perceptual tasks. Our results caution against making direct comparisons between latencies for processing different visual attributes without equating salience or considering task effects. More-salient attributes are processed faster than less-salient ones, and attributes that are critical for the task are also processed more quickly.     

Modeling perceptual learning: difficulties and how they can be overcome

We investigated the roles of feedback and attention in training a vernier discrimination task as an example of perceptual learning. Human learning even of simple stimuli, such as verniers, relies on more complex mechanisms than previously expected – ruling out simple neural network models. These findings are not just an empirical oddity but are evidence that present models fail to reflect some important characteristics of the learning process. We will list some of the problems of neural networks and develop a new model that solves them by incorporating top-down mechanisms. Contrary to neural networks, in our model learning is not driven by the set of stimuli only. Internal estimations of performance and knowledge about the task are also incorporated. Our model implies that under certain conditions the detectability of only some of the stimuli is enhanced while the overall improvement of performance is attributed to a change of decision criteria. An experiment confirms this prediction. Received: 23 May 1996 / Accepted in revised form: 16 October 1997     

Bifurcation study of a neural field competition model with an application to perceptual switching in motion integration

Perceptual multistability is a phenomenon in which alternate interpretations of a fixed stimulus are perceived intermittently. Although correlates between activity in specific cortical areas and perception have been found, the complex patterns of activity and the underlying mechanisms that gate multistable perception are little understood. Here, we present a neural field competition model in which competing states are represented in a continuous feature space. Bifurcation analysis is used to describe the different types of complex spatio-temporal dynamics produced by the model in terms of several parameters and for different inputs. The dynamics of the model was then compared to human perception investigated psychophysically during long presentations of an ambiguous, multistable motion pattern known as the barberpole illusion. In order to do this, the model is operated in a parameter range where known physiological response properties are reproduced whilst also working close to bifurcation. The model accounts for characteristic behaviour from the psychophysical experiments in terms of the type of switching observed and changes in the rate of switching with respect to contrast. In this way, the modelling study sheds light on the underlying mechanisms that drive perceptual switching in different contrast regimes. The general approach presented is applicable to a broad range of perceptual competition problems in which spatial interactions play a role.     

Permanence in an Intraguild Predation Model with Prey Switching

Intraguild predation, a form of omnivory that can occur in simple food webs when one species preys on and competes for limiting resources with another species, can have either a stabilizing effect (McCann and Hastings in Proc. R. Soc. Lond. B 264:1249-1254, 1997) or a destabilizing effect (Holt and Polis in Am. Nat. 149:745-764, 1997), depending on the assumptions of the system. Another type of behavior that has been observed in simple food web experiments (Murdoch in Ecol. Monogr. 39:335-354, 1969) is prey switching. Prey switching can occur when the predator prefers the most abundant prey. This has also been shown to be capable of having either a stabilizing effect or a destabilizing effect and even possibly lead to predator extinction (VanLeeuwen et al. in Ecology 88:1571-1581, 2007). Therefore, it is clear that incorporating prey switching into an intraguild predation model could lead to unexpected consequences. In this paper, we propose and explore such a model.     

Perceptuo-motor interactions in the perceptual organization of speech: evidence from the verbal transformation effect

The verbal transformation effect (VTE) refers to perceptual switches while listening to a speech sound repeated rapidly and continuously. It is a specific case of perceptual multistability providing a rich paradigm for studying the processes underlying the perceptual organization of speech. While the VTE has been mainly considered as a purely auditory effect, this paper presents a review of recent behavioural and neuroimaging studies investigating the role of perceptuo-motor interactions in the effect. Behavioural data show that articulatory constraints and visual information from the speaker's articulatory gestures can influence verbal transformations. In line with these data, functional magnetic resonance imaging and intracranial electroencephalography studies demonstrate that articulatory-based representations play a key role in the emergence and the stabilization of speech percepts during a verbal transformation task. Overall, these results suggest that perceptuo (multisensory)-motor processes are involved in the perceptual organization of speech and the formation of speech perceptual objects.     

Extraction of tacit knowledge from large ADME data sets via pairwise analysis

Pharmaceutical companies routinely collect data across multiple projects for common ADME endpoints. Although at the time of collection the data is intended for use in decision making within a specific project, knowledge can be gained by data mining the entire cross-project data set for patterns of structure-activity relationships (SAR) that may be applied to any project. One such data mining method is pairwise analysis. This method has the advantage of being able to identify small structural changes that lead to significant changes in activity. In this paper, we describe the process for full pairwise analysis of our high-throughput ADME assays routinely used for compound discovery efforts at Pfizer (microsomal clearance, passive membrane permeability, P-gp efflux, and lipophilicity). We also describe multiple strategies for the application of these transforms in a prospective manner during compound design. Finally, a detailed analysis of the activity patterns in pairs of compounds that share the same molecular transformation reveals multiple types of transforms from an SAR perspective. These include bioisosteres, additives, multiplicatives, and a type we call switches as they act to either turn on or turn off an activity.     

Analysis of the electroencephalographic activity during the Necker cube reversals by means of the wavelet transform

In previous studies, a perceptual switching related potential was obtained during the observation of a multistable dynamic reversal pattern, where the averaging of the single responses was triggered by subjects pressing a button. The present methodological study aims to increase the signal quality of perceptual switching related potentials considering the dependence of the measurement method on the reaction time of the subject, which may vary significantly during a session, leading to low-amplitude waveform in the averaged event-related-potential (ERP). To overcome this problem in measuring the electrophysiological correlate of an internal event, a pattern selection method based on the wavelet transform (WT) is proposed to choose a subset of single ERPs with more homogenous latencies. Nine subjects observed a Necker cube and were instructed to press the button immediately after perceptual switching. A slow, low-amplitude positive wave with frontocentral amplitude maxima was observed around 250 ms prior to the button press. After the application of a 5 octave WT on single sweeps, the time-frequency coefficients obtained in each octave were averaged across trials. The most dominant feature representing the averaged ERP was the delta (0.5–4 Hz) coefficient occurring between 250 and 125 ms before the button press. By averaging the subset of the single sweeps containing this property, a sharpening and significant amplitude increase of the response peak was observed. Received: 12 September 1997 / Accepted in revised form: 9 July 1998     

Making the Invisible Visible: Verbal but Not Visual Cues Enhance Visual Detection

Background

Can hearing a word change what one sees? Although visual sensitivity is known to be enhanced by attending to the location of the target, perceptual enhancements of following cues to the identity of an object have been difficult to find. Here, we show that perceptual sensitivity is enhanced by verbal, but not visual cues.

Methodology/Principal Findings

Participants completed an object detection task in which they made an object-presence or -absence decision to briefly-presented letters. Hearing the letter name prior to the detection task increased perceptual sensitivity (d′). A visual cue in the form of a preview of the to-be-detected letter did not. Follow-up experiments found that the auditory cuing effect was specific to validly cued stimuli. The magnitude of the cuing effect positively correlated with an individual measure of vividness of mental imagery; introducing uncertainty into the position of the stimulus did not reduce the magnitude of the cuing effect, but eliminated the correlation with mental imagery.

Conclusions/Significance

Hearing a word made otherwise invisible objects visible. Interestingly, seeing a preview of the target stimulus did not similarly enhance detection of the target. These results are compatible with an account in which auditory verbal labels modulate lower-level visual processing. The findings show that a verbal cue in the form of hearing a word can influence even the most elementary visual processing and inform our understanding of how language affects perception.     

Individual differences in perceptual switching rates; the role of occipital alpha and frontal theta band activity

Prolonged presentation of visually ambiguous figures leads to perceptual switching. Individual switching rates show great variability. The present study compares individuals with high versus low switching rates by investigating human scalp electroencephalogram and blink rates. Eight subjects viewed the Necker cube continuously and responded to perceptual switching by pressing a button. Frequent switchers showed characteristic occipital alpha and frontal theta band activity prior to a switch, whereas infrequent switchers did not. The alpha activity was specific to switching, the theta activity was generic to perceptual processing conditions. A negative correlation was observed between perceptual switching and blink rates. These results suggest that the ability to concentrate attentional effort on the task is responsible for the differences in perceptual switching rates     

Interhemispheric switching mediates perceptual rivalry

BACKGROUND: Binocular rivalry refers to the alternating perceptual states that occur when the images seen by the two eyes are too different to be fused into a single percept. Logothetis and colleagues have challenged suggestions that this phenomenon occurs early in the visual pathway. They have shown that, in alert monkeys, neurons in the primary visual cortex continue to respond to their preferred stimulus despite the monkey reporting its absence. Moreover, they found that neural activity higher in the visual pathway is highly correlated with the monkey's reported percept. These and other findings suggest that the neural substrate of binocular rivalry must involve high levels, perhaps the same levels involved in reversible figure alternations. RESULTS: We present evidence that activation or disruption of a single hemisphere in human subjects affects the perceptual alternations of binocular rivalry. Unilateral caloric vestibular stimulation changed the ratio of time spent in each competing perceptual state. Transcranial magnetic stimulation applied to one hemisphere disrupted normal perceptual alternations when the stimulation was timed to occur at one phase of the perceptual switch, but not at the other. Furthermore, activation of a single hemisphere by caloric stimulation affected the perceptual alternations of a reversible figure, the Necker cube. CONCLUSIONS: Our findings suggest that interhemispheric switching mediates perceptual rivalry. Thus, competition for awareness in both binocular rivalry and reversible figures occurs between, rather than within, each hemisphere. This interhemispheric switch hypothesis has implications for understanding the neural mechanisms of conscious experience and also has clinical relevance as the rate of both types of perceptual rivalry is slow in bipolar disorder (manic depression).     

HOST LIFE HISTORY AND THE EVOLUTION OF PARASITE VIRULENCE

Abstract.— We present a general epidemiological model of host‐parasite interactions that includes various forms of superinfection. We use this model to study the effects of different host life‐history traits on the evolution of parasite virulence. In particular, we analyze the effects of natural host death rate on the evolutionarily stable parasite virulence. We show that, contrary to classical predictions, an increase in the natural host death rate may select for lower parasite virulence if some form of superinfection occurs. This result is in agreement with the experimental results and the verbal argument presented by Ebert and Mangin (1997). This experiment is discussed in the light of the present model. We also point out the importance of superinfections for the effect of nonspecific immunity on the evolution of virulence. In a broader perspective, this model demonstrates that the occurrence of multiple infections may qualitatively alter classical predictions concerning the effects of various host life‐history traits on the evolution of parasite virulence.     

Predicting Odor Perceptual Similarity from Odor Structure

To understand the brain mechanisms of olfaction we must understand the rules that govern the link between odorant structure and odorant perception. Natural odors are in fact mixtures made of many molecules, and there is currently no method to look at the molecular structure of such odorant-mixtures and predict their smell. In three separate experiments, we asked 139 subjects to rate the pairwise perceptual similarity of 64 odorant-mixtures ranging in size from 4 to 43 mono-molecular components. We then tested alternative models to link odorant-mixture structure to odorant-mixture perceptual similarity. Whereas a model that considered each mono-molecular component of a mixture separately provided a poor prediction of mixture similarity, a model that represented the mixture as a single structural vector provided consistent correlations between predicted and actual perceptual similarity (r≥0.49, p<0.001). An optimized version of this model yielded a correlation of r = 0.85 (p<0.001) between predicted and actual mixture similarity. In other words, we developed an algorithm that can look at the molecular structure of two novel odorant-mixtures, and predict their ensuing perceptual similarity. That this goal was attained using a model that considers the mixtures as a single vector is consistent with a synthetic rather than analytical brain processing mechanism in olfaction.     

Stimulus-induced bifurcations in discrete-time neural oscillators

Based on theoretical issues and neurobiological evidence, considerable interest has recently focused on dynamic computational elements in neural systems. Such elements respond to stimuli by altering their dynamical behavior rather than by changing a scalar output. In particular, neural oscillators capable of chaotic dynamics represent a potentially very rich substrate for complex spatiotemporal information processing. However, the response properties of such systems must be studied in detail before they can be used as computational elements in neural models. In this paper, we focus on the response of a very simple discrete-time neural oscillator model to a fixed input. We show that the oscillator responds to the stimulus through a fairly complex set of bifurcations, and shows critical switching between attractors. This information can be used to construct very sophisticated dynamic computational elements with well-understood response properties. Examples of such elements are presented in the paper. We end with a brief discussion of simple architectures for networks of dynamical elements, and the relevance of our results to neurobiological models. Received: 7 August 1997 / Accepted in revised form: 22 April 1998     

Variability of perceptual multistability: from brain state to individual trait

Few phenomena are as suitable as perceptual multistability to demonstrate that the brain constructively interprets sensory input. Several studies have outlined the neural circuitry involved in generating perceptual inference but only more recently has the individual variability of this inferential process been appreciated. Studies of the interaction of evoked and ongoing neural activity show that inference itself is not merely a stimulus-triggered process but is related to the context of the current brain state into which the processing of external stimulation is embedded. As brain states fluctuate, so does perception of a given sensory input. In multistability, perceptual fluctuation rates are consistent for a given individual but vary considerably between individuals. There has been some evidence for a genetic basis for these individual differences and recent morphometric studies of parietal lobe regions have identified neuroanatomical substrates for individual variability in spontaneous switching behaviour. Moreover, disrupting the function of these latter regions by transcranial magnetic stimulation yields systematic interference effects on switching behaviour, further arguing for a causal role of these regions in perceptual inference. Together, these studies have advanced our understanding of the biological mechanisms by which the brain constructs the contents of consciousness from sensory input.