Decentralized Opportunistic Spectrum Resources Access Model and Algorithm toward Cooperative Ad-Hoc Networks

Limited communication resources have gradually become a critical factor toward efficiency of decentralized large scale multi-agent coordination when both system scales up and tasks become more complex. In current researches, due to the agent’s limited communication and observational capability, an agent in a decentralized setting can only choose a part of channels to access, but cannot perceive or share global information. Each agent’s cooperative decision is based on the partial observation of the system state, and as such, uncertainty in the communication network is unavoidable. In this situation, it is a major challenge working out cooperative decision-making under uncertainty with only a partial observation of the environment. In this paper, we propose a decentralized approach that allows agents cooperatively search and independently choose channels. The key to our design is to build an up-to-date observation for each agent’s view so that a local decision model is achievable in a large scale team coordination. We simplify the Dec-POMDP model problem, and each agent can jointly work out its communication policy in order to improve its local decision utilities for the choice of communication resources. Finally, we discuss an implicate resource competition game, and show that, there exists an approximate resources access tradeoff balance between agents. Based on this discovery, the tradeoff between real-time decision-making and the efficiency of cooperation using these channels can be well improved.     

Decomposing Effects of Time on Task Reveals an Anteroposterior Gradient of Perceptual Decision Regions

In perceptual decision making, the selection of an appropriate action depends critically on an organism’s ability to use sensory inputs to accumulate evidence for a decision. However, differentiating decision-related processes from effects of “time on task” can be difficult. Here we combine the response signal paradigm, in which the experimenter rather than the subject dictates the time of the response, and independent components analysis (ICA) to search for signatures consistent with time on task and decision making, respectively, throughout the brain. Using this novel approach, we identify two such independent components from BOLD activity related to a random dot motion task: one sensitive to the main effect of stimulus duration, and one to both the main effect of motion coherence and its interaction with duration. Furthermore, we demonstrate that these two components are expressed differently throughout the brain, with activity in occipital regions most reflective of the former, activity within intraparietal sulcus modulated by both factors, and more anterior regions including the anterior insula, pre-SMA, and inferior frontal sulcus driven almost exclusively by the latter. Consistent with these ICA findings, cluster analysis identifies a posterior-to-anterior gradient that differentiates regions sensitive to time on task from regions whose activity is strongly tied to motion coherence. Together, these findings demonstrate that progressively more anterior regions are likely to participate in progressively more proximate decision-related processes.     

Dominance of Objects over Context in a Mediotemporal Lobe Model of Schizophrenia

Background

A large body of evidence suggests impaired context processing in schizophrenia. Here we propose that this impairment arises from defective integration of mediotemporal ‘what’ and ‘where’ routes, carrying object and spatial information to the hippocampus.

Methodology and Findings

We have previously shown, in a mediotemporal lobe (MTL) model, that the abnormal connectivity between MTL regions observed in schizophrenia can explain the episodic memory deficits associated with the disorder. Here we show that the same neuropathology leads to several context processing deficits observed in patients with schizophrenia: 1) failure to choose subordinate stimuli over dominant ones when the former fit the context, 2) decreased contextual constraints in memory retrieval, as reflected in increased false alarm rates and 3) impaired retrieval of contextual information in source monitoring. Model analyses show that these deficits occur because the ‘schizophrenic MTL’ forms fragmented episodic representations, in which objects are overrepresented at the expense of spatial contextual information.

Conclusions and Significance

These findings highlight the importance of MTL neuropathology in schizophrenia, demonstrating that it may underlie a broad spectrum of deficits, including context processing and memory impairments. It is argued that these processing deficits may contribute to central schizophrenia symptoms such as contextually inappropriate behavior, associative abnormalities, conversational drift, concreteness and delusions.     

A neural network model of basal ganglia’s decision-making circuitry

The basal ganglia have been increasingly recognized as an important structure involved in decision making. Neurons in the basal ganglia were found to reflect the evidence accumulation process during decision making. However, it is not well understood how the direct and indirect pathways of the basal ganglia work together for decision making. Here, we create a recurrent neural network model that is composed of the direct and indirect pathways and test it with the classic random dot motion discrimination task. The direct pathway drives the outputs, which are modulated through a gating mechanism controlled by the indirect pathway. We train the network to learn the task and find that the network reproduces the accuracy and reaction time patterns of previous animal studies. Units in the model exhibit ramping activities that reflect evidence accumulation. Finally, we simulate manipulations of the direct and indirect pathways and find that the manipulations of the direct pathway mainly affect the choice while the manipulations of the indirect pathway affect the model’s reaction time. These results suggest a potential circuitry mechanism of the basal ganglia’s role in decision making with predictions that can be tested experimentally in the future.     

The Neural Basis of Responsibility Attribution in Decision-Making

Social responsibility links personal behavior with societal expectations and plays a key role in affecting an agent’s emotional state following a decision. However, the neural basis of responsibility attribution remains unclear. In two previous event-related brain potential (ERP) studies we found that personal responsibility modulated outcome evaluation in gambling tasks. Here we conducted a functional magnetic resonance imaging (fMRI) study to identify particular brain regions that mediate responsibility attribution. In a context involving team cooperation, participants completed a task with their teammates and on each trial received feedback about team success and individual success sequentially. We found that brain activity differed between conditions involving team success vs. team failure. Further, different brain regions were associated with reinforcement of behavior by social praise vs. monetary reward. Specifically, right temporoparietal junction (RTPJ) was associated with social pride whereas dorsal striatum and dorsal anterior cingulate cortex (ACC) were related to reinforcement of behaviors leading to personal gain. The present study provides evidence that the RTPJ is an important region for determining whether self-generated behaviors are deserving of praise in a social context.     

Spatial Memory in Spontaneously Hypertensive Rats (SHR)

The spontaneously hypertensive rat (SHR) is an established animal model of ADHD. It has been suggested that ADHD symptoms arise from deficits in executive functions such as working memory, attentional control and decision making. Both ADHD patients and SHRs show deficits in spatial working memory. However, the data on spatial working memory deficits in SHRs are not consistent. It has been suggested that the reported cognitive deficits of SHRs may be related to the SHRs’ locomotor activity. We have used a holeboard (COGITAT) to study both cognition and activity in order to evaluate the influence of the activity on the cognitive performance of SHRs. In comparison to Wistar-Kyoto (WKY) rats, SHRs did not have any impairment in spatial working memory and reference memory. When the rats’ locomotor activity was taken into account, the SHRs’ working memory and reference memory were significantly better than in WKY rats. The locomotor activity appears to be a confounding factor in spatial memory tasks and should therefore be controlled for in future studies. In the SHR model of ADHD, we were unable to demonstrate an impairment of working memory which has been reported in patients with ADHD.     

Monte Carlo Planning Method Estimates Planning Horizons during Interactive Social Exchange

Reciprocating interactions represent a central feature of all human exchanges. They have been the target of various recent experiments, with healthy participants and psychiatric populations engaging as dyads in multi-round exchanges such as a repeated trust task. Behaviour in such exchanges involves complexities related to each agent’s preference for equity with their partner, beliefs about the partner’s appetite for equity, beliefs about the partner’s model of their partner, and so on. Agents may also plan different numbers of steps into the future. Providing a computationally precise account of the behaviour is an essential step towards understanding what underlies choices. A natural framework for this is that of an interactive partially observable Markov decision process (IPOMDP). However, the various complexities make IPOMDPs inordinately computationally challenging. Here, we show how to approximate the solution for the multi-round trust task using a variant of the Monte-Carlo tree search algorithm. We demonstrate that the algorithm is efficient and effective, and therefore can be used to invert observations of behavioural choices. We use generated behaviour to elucidate the richness and sophistication of interactive inference.     

“Give,but Give until It Hurts”: The Modulatory Role of Trait Emotional Intelligence on the Motivation to Help

Two studies investigated the effect of trait Emotional Intelligence (trait EI) on people’s motivation to help. In Study 1, we developed a new computer-based paradigm that tested participants’ motivation to help by measuring their performance on a task in which they could gain a hypothetical amount of money to help children in need. Crucially, we manipulated participants’ perceived efficacy by informing them that they had been either able to save the children (positive feedback) or unable to save the children (negative feedback). We measured trait EI using the Trait Emotional Intelligence Questionnaire–Short Form (TEIQue-SF) and assessed participants’ affective reactions during the experiment using the PANAS-X. Results showed that high and low trait EI participants performed differently after the presentation of feedback on their ineffectiveness in helping others in need. Both groups showed increasing negative affective states during the experiment when the feedback was negative; however, high trait EI participants better managed their affective reactions, modulating the impact of their emotions on performance and maintaining a high level of motivation to help. In Study 2, we used a similar computerized task and tested a control situation to explore the effect of trait EI on participants’ behavior when facing failure or success in a scenario unrelated to helping others in need. No effect of feedback emerged on participants’ emotional states in the second study. Taken together our results show that trait EI influences the impact of success and failure on behavior only in affect-rich situation like those in which people are asked to help others in need.     

The Sense of Agency during Continuous Action: Performance Is More Important than Action-Feedback Association

The sense of agency refers to the feeling that one is controlling events through one’s own behavior. This study examined how task performance and the delay of events influence one’s sense of agency during continuous action accompanied by a goal. The participants were instructed to direct a moving dot into a square as quickly as possible by pressing the left and right keys on a keyboard to control the direction in which the dot traveled. The interval between the key press and response of the dot (i.e., direction change) was manipulated to vary task difficulty. Moreover, in the assisted condition, the computer ignored participants’ erroneous commands, resulting in improved task performance but a weaker association between the participants’ commands and actual movements of the dot relative to the condition in which all of the participants’ commands were executed (i.e., self-control condition). The results showed that participants’ sense of agency increased with better performance in the assisted condition relative to the self-control condition, even though a large proportion of their commands were not executed. We concluded that, when the action-feedback association was uncertain, cognitive inference was more dominant relative to the process of comparing predicted and perceived information in the judgment of agency.     

Nicotine Increases Impulsivity and Decreases Willingness to Exert Cognitive Effort despite Improving Attention in “Slacker” Rats: Insights into Cholinergic Regulation of Cost/Benefit Decision Making

Successful decision making in our daily lives requires weighing an option’s costs against its associated benefits. The neuromodulator acetylcholine underlies both the etiology and treatment of a number of illnesses in which decision making is perturbed, including Alzheimer’s disease, attention-deficit/hyperactivity disorder, and schizophrenia. Nicotine acts on the cholinergic system and has been touted as a cognitive enhancer by both smokers and some researchers for its attention-boosting effects; however, it is unclear whether treatments that have a beneficial effect on attention would also have a beneficial effect on decision making. Here we utilize the rodent Cognitive Effort Task (rCET), wherein animals can choose to allocate greater visuospatial attention for a greater reward, to examine cholinergic contributions to both attentional performance and choice based on attentional demand. Following the establishment of baseline behavior, four drug challenges were administered: nicotine, mecamylamine, scopolamine, and oxotremorine (saline plus three doses for each). As per previous rCET studies, animals were divided by their baseline preferences, with “worker” rats choosing high-effort/high-reward options more than their “slacker” counterparts. Nicotine caused slackers to choose even fewer high-effort trials than at baseline, but had no effect on workers’ choice. Despite slackers’ decreased willingness to expend effort, nicotine improved their attentional performance on the task. Nicotine also increased measures of motor impulsivity in all animals. In contrast, scopolamine decreased animals’ choice of high-effort trials, especially for workers, while oxotremorine decreased motor impulsivity for all animals. In sum, the cholinergic system appears to contribute to decision making, and in part these contributions can be understood as a function of individual differences. While nicotine has been considered as a cognitive enhancer, these data suggest that its modest benefits to attention may be coupled with impulsiveness and decreased willingness to work hard, especially in individuals who are particularly sensitive to effort costs (i.e. slackers).     

Morris Water Maze Test: Optimization for Mouse Strain and Testing Environment

The Morris water maze (MWM) is a commonly used task to assess hippocampal-dependent spatial learning and memory in transgenic mouse models of disease, including neurocognitive disorders such as Alzheimer’s disease. However, the background strain of the mouse model used can have a substantial effect on the observed behavioral phenotype, with some strains exhibiting superior learning ability relative to others. To ensure differences between transgene negative and transgene positive mice can be detected, identification of a training procedure sensitive to the background strain is essential. Failure to tailor the MWM protocol to the background strain of the mouse model may lead to under- or over- training, thereby masking group differences in probe trials. Here, a MWM protocol tailored for use with the F1 FVB/N x 129S6 background is described. This is a frequently used background strain to study the age-dependent effects of mutant P301L tau (rTg(TauP301L)4510 mice) on the memory deficits associated with Alzheimer’s disease. Also described is a strategy to re-optimize, as dictated by the particular testing environment utilized.     

Motor Cost Influences Perceptual Decisions

Perceptual decision making has been widely studied using tasks in which subjects are asked to discriminate a visual stimulus and instructed to report their decision with a movement. In these studies, performance is measured by assessing the accuracy of the participants’ choices as a function of the ambiguity of the visual stimulus. Typically, the reporting movement is considered as a mere means of reporting the decision with no influence on the decision-making process. However, recent studies have shown that even subtle differences of biomechanical costs between movements may influence how we select between them. Here we investigated whether this purely motor cost could also influence decisions in a perceptual discrimination task in detriment of accuracy. In other words, are perceptual decisions only dependent on the visual stimulus and entirely orthogonal to motor costs? Here we show the results of a psychophysical experiment in which human subjects were presented with a random dot motion discrimination task and asked to report the perceived motion direction using movements of different biomechanical cost. We found that the pattern of decisions exhibited a significant bias towards the movement of lower cost, even when this bias reduced performance accuracy. This strongly suggests that motor costs influence decision making in visual discrimination tasks for which its contribution is neither instructed nor beneficial.     

Linking Perception,Cognition, and Action: Psychophysical Observations and Neural Network Modelling

It has been argued that perception, decision making, and movement planning are in reality tightly interwoven brain processes. However, how they are implemented in neural circuits is still a matter of debate. We tested human subjects in a temporal categorization task in which intervals had to be categorized as short or long. Subjects communicated their decision by moving a cursor into one of two possible targets, which appeared separated by different angles from trial to trial. Even though there was a 1 second-long delay between interval presentation and decision communication, categorization difficulty affected subjects’ performance, reaction (RT) and movement time (MT). In addition, reaction and movement times were also influenced by the distance between the targets. This implies that not only perceptual, but also movement-related considerations were incorporated into the decision process. Therefore, we searched for a model that could use categorization difficulty and target separation to describe subjects’ performance, RT, and MT. We developed a network consisting of two mutually inhibiting neural populations, each tuned to one of the possible categories and composed of an accumulation and a memory node. This network sequentially acquired interval information, maintained it in working memory and was then attracted to one of two possible states, corresponding to a categorical decision. It faithfully replicated subjects’ RT and MT as a function of categorization difficulty and target distance; it also replicated performance as a function of categorization difficulty. Furthermore, this model was used to make new predictions about the effect of untested durations, target distances and delay durations. To our knowledge, this is the first biologically plausible model that has been proposed to account for decision making and communication by integrating both sensory and motor planning information.     

The Relevance of Emotional Intelligence in Personnel Selection for High Emotional Labor Jobs

Although a large number of studies have pointed to the potential of emotional intelligence (EI) in the context of personnel selection, research in real-life selection contexts is still scarce. The aim of the present study was to examine whether EI would predict Assessment Center (AC) ratings of job-relevant competencies in a sample of applicants for the position of a flight attendant. Applicants’ ability to regulate emotions predicted performance in group exercises. However, there were inconsistent effects of applicants’ ability to understand emotions: Whereas the ability to understand emotions had a positive effect on performance in interview and role play, the effect on performance in group exercises was negative. We suppose that the effect depends on task type and conclude that tests of emotional abilities should be used judiciously in personnel selection procedures.     

Oxytocin Effect on Collective Decision Making: A Randomized Placebo Controlled Study

Collective decision making often benefits both the individuals and the group in a variety of contexts. However, for the group to be successful, individuals should be able to strike a balance between their level of competence and their influence on the collective decisions. The hormone oxytocin has been shown to promote trust, conformism and attention to social cues. We wondered if this hormone may increase participants’ (unwarranted) reliance on their partners’ opinion, resulting in a reduction in collective benefit by disturbing the balance between influence and competence. To test this hypothesis we employed a randomized double-blind placebo-controlled design in which male dyads self-administered intranasal oxytocin or placebo and then performed a visual search task together. Compared to placebo, collective benefit did not decrease under oxytocin. Using an exploratory time dependent analysis, we observed increase in collective benefit over time under oxytocin. Moreover, trial-by-trial analysis showed that under oxytocin the more competent member of each dyad was less likely to change his mind during disagreements, while the less competent member showed a greater willingness to change his mind and conform to the opinion of his more reliable partner. This role-dependent effect may be mediated by enhanced monitoring of own and other’s performance level under oxytocin. Such enhanced social learning could improve the balance between influence and competence and lead to efficient and beneficial collaboration.     

The Gambler’s Fallacy Is Associated with Weak Affective Decision Making but Strong Cognitive Ability

Humans demonstrate an inherent bias towards making maladaptive decisions, as shown by a phenomenon known as the gambler’s fallacy (GF). The GF has been traditionally considered as a heuristic bias supported by the fast and automatic intuition system, which can be overcome by the reasoning system. The present study examined an intriguing hypothesis, based on emerging evidence from neuroscience research, that the GF might be attributed to a weak affective but strong cognitive decision making mechanism. With data from a large sample of college students, we found that individuals’ use of the GF strategy was positively correlated with their general intelligence and executive function, such as working memory and conflict resolution, but negatively correlated with their affective decision making capacities, as measured by the Iowa Gambling Task. Our result provides a novel insight into the mechanisms underlying the GF, which highlights the significant role of affective mechanisms in adaptive decision-making.     

Free and Cued Recall Memory in Parkinson’s Disease Associated with Amnestic Mild Cognitive Impairment

The hypothesis has been advanced that memory disorders in individuals with Parkinson’s disease (PD) are related to either retrieval or consolidation failure. However, the characteristics of the memory impairments of PD patients with amnestic mild cognitive impairment have not been clarified. This study was aimed at investigating whether memory deficits in PD patients with amnestic mild cognitive impairment (PDaMCI) are due to failure of retrieval or consolidation processes. Sixteen individuals with PDaMCI, 20 with amnestic mild cognitive impairment without PD (aMCINPD), and 20 healthy controls were recruited. Participants were administered the Free and Cued Selective Reminding Test. An index of cueing was computed for each subject to capture the advantage in retrieval of cued compared to free recall. Individuals with PDaMCI performed worse than healthy controls on the free recall (p<0.01) but not the cued recall (p>0.10) task, and they performed better than aMCINPD subjects on both recall measures (p<0.01). The index of cueing of subjects with PD was comparable to that of healthy controls (p>0.10) but it was significantly higher than that of the aMCINPD sample (p<0.01). Moreover, PD patients’ performance on free recall trials was significantly predicted by scores on a test investigating executive functions (i.e., the Modified Card Sorting Test; p = 0.042). Findings of the study document that, in subjects with amnestic mild cognitive impairment associated to PD, episodic memory impairment is related to retrieval rather than to consolidation failure. The same data suggest that, in these individuals, memory deficits might be due to altered frontal-related executive functioning.     

Decision prioritization and causal reasoning in decision hierarchies

From cooking a meal to finding a route to a destination, many real life decisions can be decomposed into a hierarchy of sub-decisions. In a hierarchy, choosing which decision to think about requires planning over a potentially vast space of possible decision sequences. To gain insight into how people decide what to decide on, we studied a novel task that combines perceptual decision making, active sensing and hierarchical and counterfactual reasoning. Human participants had to find a target hidden at the lowest level of a decision tree. They could solicit information from the different nodes of the decision tree to gather noisy evidence about the target’s location. Feedback was given only after errors at the leaf nodes and provided ambiguous evidence about the cause of the error. Despite the complexity of task (with 10⁷ latent states) participants were able to plan efficiently in the task. A computational model of this process identified a small number of heuristics of low computational complexity that accounted for human behavior. These heuristics include making categorical decisions at the branching points of the decision tree rather than carrying forward entire probability distributions, discarding sensory evidence deemed unreliable to make a choice, and using choice confidence to infer the cause of the error after an initial plan failed. Plans based on probabilistic inference or myopic sampling norms could not capture participants’ behavior. Our results show that it is possible to identify hallmarks of heuristic planning with sensing in human behavior and that the use of tasks of intermediate complexity helps identify the rules underlying human ability to reason over decision hierarchies.     

Lesions of the Basal Forebrain Cholinergic System in Mice Disrupt Idiothetic Navigation

Loss of integrity of the basal forebrain cholinergic neurons is a consistent feature of Alzheimer’s disease, and measurement of basal forebrain degeneration by magnetic resonance imaging is emerging as a sensitive diagnostic marker for prodromal disease. It is also known that Alzheimer’s disease patients perform poorly on both real space and computerized cued (allothetic) or uncued (idiothetic) recall navigation tasks. Although the hippocampus is required for allothetic navigation, lesions of this region only mildly affect idiothetic navigation. Here we tested the hypothesis that the cholinergic medial septo-hippocampal circuit is important for idiothetic navigation. Basal forebrain cholinergic neurons were selectively lesioned in mice using the toxin saporin conjugated to a basal forebrain cholinergic neuronal marker, the p75 neurotrophin receptor. Control animals were able to learn and remember spatial information when tested on a modified version of the passive place avoidance test where all extramaze cues were removed, and animals had to rely on idiothetic signals. However, the exploratory behaviour of mice with cholinergic basal forebrain lesions was highly disorganized during this test. By contrast, the lesioned animals performed no differently from controls in tasks involving contextual fear conditioning and spatial working memory (Y maze), and displayed no deficits in potentially confounding behaviours such as motor performance, anxiety, or disturbed sleep/wake cycles. These data suggest that the basal forebrain cholinergic system plays a specific role in idiothetic navigation, a modality that is impaired early in Alzheimer’s disease.