Visual learning in multiple-object tracking

Background

Tracking moving objects in space is important for the maintenance of spatiotemporal continuity in everyday visual tasks. In the laboratory, this ability is tested using the Multiple Object Tracking (MOT) task, where participants track a subset of moving objects with attention over an extended period of time. The ability to track multiple objects with attention is severely limited. Recent research has shown that this ability may improve with extensive practice (e.g., from action videogame playing). However, whether tracking also improves in a short training session with repeated trajectories has rarely been investigated. In this study we examine the role of visual learning in multiple-object tracking and characterize how varieties of attention interact with visual learning.

Methodology/Principal Findings

Participants first conducted attentive tracking on trials with repeated motion trajectories for a short session. In a transfer phase we used the same motion trajectories but changed the role of tracking targets and nontargets. We found that compared with novel trials, tracking was enhanced only when the target subset was the same as that used during training. Learning did not transfer when the previously trained targets and nontargets switched roles or mixed up. However, learning was not specific to the trained temporal order as it transferred to trials where the motion was played backwards.

Conclusions/Significance

These findings suggest that a demanding task of tracking multiple objects can benefit from learning of repeated motion trajectories. Such learning potentially facilitates tracking in natural vision, although learning is largely confined to the trajectories of attended objects. Furthermore, we showed that learning in attentive tracking relies on relational coding of all target trajectories. Surprisingly, learning was not specific to the trained temporal context, probably because observers have learned motion paths of each trajectory independently of the exact temporal order.     

Spatial memory shapes migration and its benefits: evidence from a large herbivore

From fine‐scale foraging to broad‐scale migration, animal movement is shaped by the distribution of resources. There is mounting evidence, however, that learning and memory also guide movement. Although migratory mammals commonly track resource waves, how resource tracking and memory guide long‐distance migration has not been reconciled. We examined these hypotheses using movement data from four populations of migratory mule deer (n = 91). Spatial memory had an extraordinary influence on migration, affecting movement 2–28 times more strongly than tracking spring green‐up or autumn snow depth. Importantly, with only an ability to track resources, simulated deer were unable to recreate empirical migratory routes. In contrast, simulated deer with memory of empirical routes used those routes and obtained higher foraging benefits. For migratory terrestrial mammals, spatial memory provides knowledge of where seasonal ranges and migratory routes exist, whereas resource tracking determines when to beneficially move within those areas.     

Hemifield effects in multiple identity tracking

In everyday life, we often need to attentively track moving objects. A previous study has claimed that this tracking occurs independently in the left and right visual hemifields (Alvarez & Cavanagh, 2005, Psychological Science,16, 637–647). Specifically, it was shown that observers were much more accurate at tracking objects that were spread over both visual hemifields as opposed to when all were confined to a single visual hemifield. In that study, observers were not required to remember the identities of the objects. Conversely, in real life, there is seldom any benefit to tracking an object unless you can also recall its identity. It has been predicted that when observers are required to remember the identities of the tracked objects a bilateral advantage should no longer be observed (Oksama & Hyönä, 2008, Cognitive Psychology, 56, 237–283). We tested this prediction and found that a bilateral advantage still occurred, though it was not as strong as when observers were not required to remember the identities of the targets. Even in the later case we found that tracking was not completely independent in the two visual hemifields. We present a combined model of multiple object tracking and multiple identity tracking that can explain our data.     

Can Attention Be Confined to Just Part of a Moving Object? Revisiting Target-Distractor Merging in Multiple Object Tracking

While it was initially thought that attention was space-based, more recent work has shown that attention can also be object-based, in that observers find it easier to attend to different parts of the same object than to different parts of different objects. Such studies have shown that attention more easily spreads throughout an object than between objects. However, it is not known to what extent attention can be confined to just part of an object and to what extent attending to part of an object necessarily causes the entire object to be attended. We have investigated this question in the context of the multiple object tracking paradigm in which subjects are shown a scene containing a number of identical moving objects and asked to mentally track a subset of them, the targets, while not tracking the remainder, the distractors. Previous work has shown that joining each target to a distractor by a solid connector so that each target-distractor pair forms a single physical object, a technique known as target-distractor merging, makes it hard to track the targets, suggesting that attention cannot be restricted to just parts of objects. However, in that study the target-distractor pairs continuously changed length, which in itself would have made tracking difficult. Here we show that it remains difficult to track the targets even when the target-distractor pairs do not change length and even when the targets can be differentiated from the connectors that join them to the distractors. Our experiments suggest that it is hard to confine attention to just parts of objects, at least in the case of moving objects.     

Fluctuations and synchronizations of neural activities during sleep: Neural basis of possible sleep functions?

Physiological and psychological evidence have been accumulated concerning the function of sleep in development and learning/memory. Many conceptual ideas have been proposed to elucidate the mechanisms underlying them. Sleep consists of a wide variety of physiological processes. It has not yet been clarified which processes are involved in development and learning/memory processes. We have found that single neuronal activity exhibits a slowly fluctuating rate of discharge during rapid eye movement (REM) sleep and a random low discharge rate during non-rapid eye movement (NREM) sleep. It is suggested that a structural change of the neural network attractor underlies this neuronal dynamics-alternation by mathematical modeling. Functional interpretation of the neuronal dynamics-alternation was provided in combination with the phase locking of ponto-geniculo-occipital (PGO)/pontine (P) wave to the hippocampal theta wave, each of which is known to be involved in learning/memory processes. More directly, by the long-term sensory deprivation, the dynamics of neural activity during sleep was found to progressively change in a non-monotonic way. This finding reveals a possible interaction between sleep and reorganization of neural network in the matured brain. Here, in addition to the related findings, we described our idea about how sleep contributes to the learning/memory processes and reorganization of neural network of the matured brain through characteristic neural activities during sleep.

     

Postural Sway and Gaze Can Track the Complex Motion of a Visual Target

Variability is an inherent and important feature of human movement. This variability has form exhibiting a chaotic structure. Visual feedback training using regular predictive visual target motions does not take into account this essential characteristic of the human movement, and may result in task specific learning and loss of visuo-motor adaptability. In this study, we asked how well healthy young adults can track visual target cues of varying degree of complexity during whole-body swaying in the Anterior-Posterior (AP) and Medio-Lateral (ML) direction. Participants were asked to track three visual target motions: a complex (Lorenz attractor), a noise (brown) and a periodic (sine) moving target while receiving online visual feedback about their performance. Postural sway, gaze and target motion were synchronously recorded and the degree of force-target and gaze-target coupling was quantified using spectral coherence and Cross-Approximate entropy. Analysis revealed that both force-target and gaze-target coupling was sensitive to the complexity of the visual stimuli motions. Postural sway showed a higher degree of coherence with the Lorenz attractor than the brown noise or sinusoidal stimulus motion. Similarly, gaze was more synchronous with the Lorenz attractor than the brown noise and sinusoidal stimulus motion. These results were similar regardless of whether tracking was performed in the AP or ML direction. Based on the theoretical model of optimal movement variability tracking of a complex signal may provide a better stimulus to improve visuo-motor adaptation and learning in postural control.     

Preservation of musical memory in an amnesic professional cellist

Learning and memory of music involves a multitude of perceptual, motor, affective, and autobiographical memory processes [1]. Patient and imaging studies suggest that musical memory may involve distinct neural substrates [2,3]. However, the degree of independence of such a system from other memory domains is controversial [4]. We have investigated a 68-year-old professional cellist, patient PM, who developed severe amnesia following encephalitis. This case provided a unique opportunity to study musical memory in a patient with a precisely defined premorbid musical knowledge and well-demarcated focal lesions of the brain. Despite severe memory impairments, he performed like healthy musicians in various tests of recognition memory for music. These findings suggest that learning and retention of musical information depends on brain networks distinct from those involved in other types of episodic and semantic memory.     

多目标视觉追踪中的分组效应及其可加性

如何减少注意资源的消耗、提升人类在动态视觉持续性注意任务中的表现,是持续性注意研究关注的重点问题,具有理论和实践的重要意义。多目标追踪任务是研究个体持续性注意的常用实验室方法。多目标追踪任务中,观察者可以利用基于物体特征的分组效应将多个运动目标知觉为一个更大的运动单元,从而减少注意资源的消耗、提高追踪任务表现。为了进一步节省注意资源、提升注意追踪的表现,研究者提出了注意追踪中分组效应的可加性问题。分组效应的可加性表现为基于两个及以上特征的分组对追踪表现的提高优于基于一个特征的分组。可加性的研究对理解不同分组效应的认知机制,个体动态视觉追踪中的注意机制和注意资源分配等具有重要意义。本文对以往的行为以及神经影像学研究进行了汇总,讨论了不同类型分组效应的知觉加工机制及其可加性,系统阐述了基于不同表面特征的不可加性,和基于表面特征与特定时空特征可加性的认知及其神经基础。未来可以从行为学实验角度探究更多基于不同特征分组效应的可加性,或者从注意追踪中基于不同分组效应的神经机制入手,探讨分组效应的可加性问题,为分组效应的分类及可加性研究提供更多认知和神经层面的依据。     

The Role of Spatial Configuration in Multiple Identity Tracking

Background

The simultaneous tracking and identification of multiple moving objects encountered in everyday life requires one to correctly bind identities to objects. In the present study, we investigated the role of spatial configuration made by multiple targets when observers are asked to track multiple moving objects with distinct identities.

Methodology/Principal Findings

The overall spatial configuration made by the targets was manipulated: In the constant condition, the configuration remained as a virtual convex polygon throughout the tracking, and in the collapsed condition, one of the moving targets (critical target) crossed over an edge of the virtual polygon during tracking, destroying it. Identification performance was higher when the configuration remained intact than when it collapsed (Experiments 1a, 1b, and 2). Moreover, destroying the configuration affected the allocation of dynamic attention: the critical target captured more attention than did the other targets. However, observers were worse at identifying the critical target and were more likely to confuse it with the targets that formed the virtual crossed edge (Experiments 3–5). Experiment 6 further showed that the visual system constructs an overall configuration only by using the targets (and not the distractors); identification performance was not affected by whether the distractor violated the spatial configuration.

Conclusions/Significance

In sum, these results suggest that the visual system may integrate targets (but not distractors) into a spatial configuration during multiple identity tracking, which affects the distribution of dynamic attention and the updating of identity-location binding.     

Effect of the loci of visual cues on ability of polyrhythmic bimanual movement

Abstract

The present study investigated whether the deviation of the performed movement cycle from the required cycle during polyrhythmic bimanual (BM) movement depends on the loci of the visual cues that guide the rhythm of finger movements. Twelve healthy right-handed males rhythmically abducted and adducted the index finger or index fingers with the rhythm of the visual cues. During UM movement, the visual cue guiding the rhythm of finger movement was provided in the left or right visual hemifield. During 2:3 polyrhythmic BM movement, two visual cues, one guiding the rhythm of the left finger movement and another guiding the rhythm of the right finger movement, were provided in a single visual hemifield, or each visual cue guiding each finger movement was provided in each visual hemifield. During polyrhythmic BM movement, the cycle duration of the slower side of the movement guided by the rhythm of the visual cues provided in one visual hemifield was shorter than the required cycle duration, and the magnitude of the shortage in this condition was greater than that guided by each visual cue provided in each visual hemifield. Slower side of the movement is more precisely performed by each visual cue guiding each finger movement in each visual hemifield rather than that guided by visual cues provided in one visual hemifield during polyrhythmic BM movement. This may be explained by bottle-neck model in which visual information overflows the processing capacity when two visual processes are simultaneously provided in a single visual cortex.     

Age-Related Decline in Associative Learning in Healthy Chinese Adults

Paired associates learning (PAL) has been widely used in aging-related research, suggesting an age-related decline in associative learning. However, there are several cognitive processes (attention, spatial and recognition memory, strategy, and associative learning) involved in PAL. It is unclear which component contributes to the decline in PAL performance associated with age effects. The present study determines whether age effects on associative learning are independent of other cognitive processes involved in PAL. Using a validated computerized cognitive program (CANTAB), we examined cognitive performance of associative learning, spatial and recognition memory, attention and strategy use in 184 Singaporean Chinese adults aged from 21 to 80 years old. Linear regression revealed significant age-related decline in associative learning, spatial and recognition memory, and the level of strategy use. This age-related decline in associative learning remains even after adjusting for attention, spatial and recognition memory, and strategy use. These results show that age effects on associative learning are independent of other cognitive processes involved in PAL.     

Invariant visual object recognition: a model, with lighting invariance.

How are invariant representations of objects formed in the visual cortex? We describe a neurophysiological and computational approach which focusses on a feature hierarchy model in which invariant representations can be built by self-organizing learning based on the statistics of the visual input. The model can use temporal continuity in an associative synaptic learning rule with a short term memory trace, and/or it can use spatial continuity in Continuous Transformation learning. The model of visual processing in the ventral cortical stream can build representations of objects that are invariant with respect to translation, view, size, and in this paper we show also lighting. The model has been extended to provide an account of invariant representations in the dorsal visual system of the global motion produced by objects such as looming, rotation, and object-based movement. The model has been extended to incorporate top-down feedback connections to model the control of attention by biased competition in for example spatial and object search tasks. The model has also been extended to account for how the visual system can select single objects in complex visual scenes, and how multiple objects can be represented in a scene.     

New spines, new memories

For more than a century dendritic spines have been a source of fascination and speculation. The long-held belief that these anatomical structures are involved in learning and memory are addressed. Specifically, two lines of evidence that support this claim are reviewed. In the first, we review evidence that experimental manipulations that affect dendritic spine number in the hippocampus also affect learning processes of various sorts. In the second, we review evidence that learning itself affects the presence of dendritic spines in the hippocampus. Based on these observations, we propose that the presence of spines enhances synaptic efficacy and thereby the excitability of the network involved in the learning process. With this scheme, learning is not dependent on changes in spine density but rather changes in the presence of dendritic spines provide anatomical support for the processing of novel information used in memory formation.     

Hippocampal and ventral medial prefrontal activation during retrieval-mediated learning supports novel inference

Memory enables flexible use of past experience to inform new behaviors. Although leading theories hypothesize that this fundamental flexibility results from the formation of integrated memory networks relating multiple experiences, the neural mechanisms that support memory integration are not well understood. Here, we demonstrate that retrieval-mediated learning, whereby prior event details are reinstated during encoding of related experiences, supports participants' ability to infer relationships between distinct events that share content. Furthermore, we show that activation changes in a functionally coupled hippocampal and ventral medial prefrontal cortical circuit track the formation of integrated memories and successful inferential memory performance. These findings characterize the respective roles of these regions in retrieval-mediated learning processes that support relational memory network formation and inferential memory in the human brain. More broadly, these data reveal fundamental mechanisms through which memory representations are constructed into prospectively useful formats.     

Brain Activation of Identity Switching in Multiple Identity Tracking Task

When different objects switch identities in the multiple identity tracking (MIT) task, viewers need to rebind objects’ identity and location, which requires attention. This rebinding helps people identify the regions targets are in (where they need to focus their attention) and inhibit unimportant regions (where distractors are). This study investigated the processing of attentional tracking after identity switching in an adapted MIT task. This experiment used three identity-switching conditions: a target-switching condition (where the target objects switched identities), a distractor-switching condition (where the distractor objects switched identities), and a no-switching condition. Compared to the distractor-switching condition, the target-switching condition elicited greater activation in the frontal eye fields (FEF), intraparietal sulcus (IPS), and visual cortex. Compared to the no-switching condition, the target-switching condition elicited greater activation in the FEF, inferior frontal gyrus (pars orbitalis) (IFG-Orb), IPS, visual cortex, middle temporal lobule, and anterior cingulate cortex. Finally, the distractor-switching condition showed greater activation in the IFG-Orb compared to the no-switching condition. These results suggest that, in the target-switching condition, the FEF and IPS (the dorsal attention network) might be involved in goal-driven attention to targets during attentional tracking. In addition, in the distractor-switching condition, the activation of the IFG-Orb may indicate salient change that pulls attention away automatically.     

Brain mechanisms of emotion and emotional learning.

The amygdala appears to play an essential role in many aspects of emotional information processing and behavior. Studies over the past year have begun to clarify the anatomical organization of the amygdala and the contribution of its individual subregions to emotional functions, especially emotional learning and memory. Researchers can now point to plausible circuits involved in the transmission of sensory inputs into the amygdala, between amygdaloid subregions, and to efferent targets in cortical and subcortical regions, for specific emotional learning and memory processes.     

Activation of phasic pontine-wave generator: A mechanism for sleep-dependent memory processing

Sleep and Biological Rhythms - Sleep and learning studies suggest that memory consolidation following learning requires processes selectively active during rapid eye movement (REM) sleep. However,...     

Human cortical mechanisms of visual attention during orienting and search.

Functional anatomical studies indicate that a set of neural signals in parietal and frontal cortex mediates the covert allocation of attention to visual locations across a wide variety of visual tasks. This frontoparietal network includes areas, such as the frontal eye field and supplementary eye field. This anatomical overlap suggests that shifts of attention to visual locations of objects recruit areas involved in oculomotor programming and execution. Finally, the fronto-parietal network may be the source of spatial attentional modulations in the ventral visual system during object recognition or discrimination.     

The Drosophila learning and memory gene linotte encodes a putative receptor tyrosine kinase homologous to the human RYK gene product

The linotte mutant was isolated on the basis of its learning and memory deficit. Interestingly, linotte individuals carrying a null mutation are viable, indicating that the linotte gene is not required for vital functions. We show here that the linotte gene encodes a putative receptor tyrosine kinase, homologous to the human protein RYK. These products are unique among receptor tyrosine kinases, since they possess a short extra cellular domain, and a modified intracellular catalytic domain. In particular, the subdomains directly involved in ATP binding and phosphotransfer reaction display remarkable variations. These results suggest that linotte is part of a novel signal transduction cascade involved in learning and memory.     

A single-rate context-dependent learning process underlies rapid adaptation to familiar object dynamics

Motor learning has been extensively studied using dynamic (force-field) perturbations. These induce movement errors that result in adaptive changes to the motor commands. Several state-space models have been developed to explain how trial-by-trial errors drive the progressive adaptation observed in such studies. These models have been applied to adaptation involving novel dynamics, which typically occurs over tens to hundreds of trials, and which appears to be mediated by a dual-rate adaptation process. In contrast, when manipulating objects with familiar dynamics, subjects adapt rapidly within a few trials. Here, we apply state-space models to familiar dynamics, asking whether adaptation is mediated by a single-rate or dual-rate process. Previously, we reported a task in which subjects rotate an object with known dynamics. By presenting the object at different visual orientations, adaptation was shown to be context-specific, with limited generalization to novel orientations. Here we show that a multiple-context state-space model, with a generalization function tuned to visual object orientation, can reproduce the time-course of adaptation and de-adaptation as well as the observed context-dependent behavior. In contrast to the dual-rate process associated with novel dynamics, we show that a single-rate process mediates adaptation to familiar object dynamics. The model predicts that during exposure to the object across multiple orientations, there will be a degree of independence for adaptation and de-adaptation within each context, and that the states associated with all contexts will slowly de-adapt during exposure in one particular context. We confirm these predictions in two new experiments. Results of the current study thus highlight similarities and differences in the processes engaged during exposure to novel versus familiar dynamics. In both cases, adaptation is mediated by multiple context-specific representations. In the case of familiar object dynamics, however, the representations can be engaged based on visual context, and are updated by a single-rate process.