Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum

Food preferences are acquired through experience and can exert strong influence on choice behavior. In order to choose which food to consume, it is necessary to maintain a predictive representation of the subjective value of the associated food stimulus. Here, we explore the neural mechanisms by which such predictive representations are learned through classical conditioning. Human subjects were scanned using fMRI while learning associations between arbitrary visual stimuli and subsequent delivery of one of five different food flavors. Using a temporal difference algorithm to model learning, we found predictive responses in the ventral midbrain and a part of ventral striatum (ventral putamen) that were related directly to subjects' actual behavioral preferences. These brain structures demonstrated divergent response profiles, with the ventral midbrain showing a linear response profile with preference, and the ventral striatum a bivalent response. These results provide insight into the neural mechanisms underlying human preference behavior.     

Noise affects the shape of female preference functions for acoustic signals

The shape of female mate preference functions influences the speed and direction of sexual signal evolution. However, the expression of female preferences is modulated by interactions between environmental conditions and the female's sensory processing system. Noise is an especially relevant environmental condition because it interferes directly with the neural processing of signals. Although noise is therefore likely a significant force in the evolution of communication systems, little is known about its effects on preference function shape. In the grasshopper Chorthippus biguttulus, female preferences for male calling song characteristics are likely to be affected by noise because its auditory system is sensitive to fine temporal details of songs. We measured female preference functions for variation in male song characteristics in several levels of masking noise and found strong effects of noise on preference function shape. The overall responsiveness to signals in noise generally decreased. Preference strength increased for some signal characteristics and decreased for others, largely corresponding to expectations based on neurophysiological studies of acoustic signal processing. These results suggest that different signal characteristics will be favored under different noise conditions, and thus that signal evolution may proceed differently depending on the extent and temporal patterning of environmental noise.     

Assessment of mate preference in the house mouse with reference to investigations on assortative mating

This study analysed patterns of mate choice based on different types of laboratory test, and points out the advantages of combined methods to assess mate preference. We compared dyadic encounters and two-way choice tests involving a pair of mice or their urinary signature. Preference was assessed in males and females of the two European subspecies of the house mouse Mus musculus that share a secondary hybrid zone. A preference was deduced from directional choice or behavioural discrimination in favour of a mouse. Our results show discrepancies between the outcomes of the different types of test, which we discuss in terms of the quality of the stimuli involved, and of physical access to the information carried by those stimuli. Despite variation, our results indicate that M. m. domesticus did not show a preference, but could discriminate between stimuli of the two subspecies and tended to direct sexual behaviour assortatively. In contrast, both male and female M. m. musculus showed positive discrimination and preference for potential mates and signals carried by their own subspecies. Additionally, our results confirm that subspecies informative signals are present in mouse urine and suggest that they may be molecules of low volatility, necessitating contact for preference to be displayed.  © 2005 The Linnean Society of London, Biological Journal of the Linnean Society , 2005, 84 , 461–471.     

Interactions between substrate and temperature preference in adult American plaice (Hippoglossoides platessoides)

Laboratory experiments were conducted to determine the substrate preference of American plaice and the interaction between substrate and temperature preference. When given a choice of several substrate types, American plaice clearly preferred substrates that had a finer particle size than gravel, but did not totally avoid any substrate type. When given a choice between sand and gravel, they clearly preferred sand. Preference for substrate took precedence over temperature preference down to a temperature of‐1.0°C. An examination of field data showed that American plaice were widely distributed across both gravel and sand substrates at temperatures above and below‐1.0°C. Broad tolerances of substrate and temperature are probably a factor in this species’ wide distribution throughout the northwest Atlantic.     

Getting better all the time: improving preference scores reflect increases in the strength of filial imprinting

In the investigation of the neural mechanisms of filial imprinting, neurochemical measures are often correlated with preference score (PS): approach activity to the training stimulus/total approach in a test. In a previous study, domestic chicks, Gallus gallus domesticus, that had a PS under 65% were classed as 'poor learners' and those with a PS greater than 65% were called 'good learners'. We tested the effects of continued imprinting training in chicks from these two categories. After exposure to an imprinting stimulus for 30 min on day 1 after hatching, preferences were tested and then the chicks were exposed to the same stimulus for either 90 min, 3 h or 4 h on the next day, followed by a second preference test. In all these experiments there was a significant improvement in mean PS in the 'poor learners' between the first and second test, such that these chicks acquired a significant mean preference for the training stimulus. There was no such improvement in chicks that did not receive further training on day 2. When absolute approach was analysed, there was no significant difference between 'poor learners' and 'good learners' at the second test, after 4 h of retraining. Overall, mean preference scores increased with length of training. These results suggest that 'poor learners' are better characterized as 'slow learners', and that their initially low PS is not caused by, for example, a lack of motivation to express a preference. Preference scores reflect the strength of learning during imprinting. Copyright 2000 The Association for the Study of Animal Behaviour.     

Conservation of multivariate female preference functions and preference mechanisms in three species of trilling field crickets

Divergence in mate recognition systems among closely related species is an important contributor to assortative mating and reproductive isolation. Here, we examine divergence in male song traits and female preference functions in three cricket species with songs consisting of long trills. The shape of female preference functions appears to be mostly conserved across species and follows the predictions from a recent model for song recognition. Multivariate preference profiles, combining the pulse and trill parameters, demonstrate selectivity for conspecific pulse rates and high trill duty cycles. The rules for integration across pulse and trill timescales were identical for all three species. Generally, we find greater divergence in male song traits than in associated female preferences. For pulse rate, we find a strong match between divergent male traits and female peak preferences. Preference functions for trill parameters and carrier frequency are similar between species and show less congruence between signal and preference. Differences among traits in the degree of trait–preference (mis)match may reflect the strength of preferences and the potential for linkage disequilibrium, selective constraints and alternative selective pressures, but appear unrelated to selection for mate recognition per se.     

The evolution of mate choice in a fluctuating environment

This paper analyzes the evolutionary dynamics of a locus controlling the degree of female mating preference in a temporally fluctuating environment. Preference for mating with males with respect to their genotypes at a locus that is subject to temporally varying natural selection pressure is considered first. With weak selection and free recombination between the choice locus and the selected locus, preference for mating with heterozygotes appears to be favored. With strong selection, preference for homozygous mates may be favored. In each case, choice alleles may increase from very low initial frequencies to near fixation, in contrast to previous models of mate choice in varying environments. Linkages between the two loci has complex effects on the strength and direction of selection for mate choice. Preference for mating with males with the currently fitter genotypes at the locus under natural selection is also modelled. Provided that the environmental period is not too short, a rare allele conferring such preference may be favored and spread to fixation. Strong natural selection, tight linkage and a short environmental period may produce polymorphism for the level of mate choice.     

Individuality matters for substrate-size preference in the Nile tilapia juveniles

Preference tests have usually been used to identify nonhuman animal preferences for welfare purposes (environmental enrichment), but they are mostly at the group level—that is, group preferences for resources or environmental conditions. However, a more robust method was developed to analyze animal preference, and this method detected clear individual variation in preferences of Nile tilapia fish (Oreochromis niloticus) selecting different background colors. Here, a clear individual variability of preference was found for another type of enrichment—the sizes of substrate. Despite this variability, a consistent response was detected at the group level: Small gravel was less frequently preferred than avoided, and the more decided fish (those who preferred only one substrate size) never preferred gravel over sand-size substrate. That is, Nile tilapia avoided gravel and preferred smaller substrate, and this finding was possibly associated with their mouth gap. Considering that small gravel is a substrate often used for fish rearing, these findings highlight fish keepers’ incorrect perception of fish needs, based mostly on arbitrary criteria instead of actual fish preferences and without considering individual needs.     

Perception or preference? Mediation of gene effects in the colour choices of naive quail chicks (C. coturnix japonica)

The purpose of this study was to examine gene effects in the peripheral and central neural mediation of colour preferences in artificially selected Japanese quail chicks (Coturnix coturnix japonica). Behavioural data indicated preferences of blue over red and red over blue in the respectively selected genetic lines, and general preferences for white in both lines. Preferences were influenced by luminance variations of testing stimuli. Choices between segmented stimuli that combined blue, red, and white, in various patterns of systematically varied hues and luminances, indicated perceptual discrimination of colours in each line. Preference values combined within stimuli summated additively in choice responses, suggesting no genetic association between colour preference and colour perception. Electrophysiological data indicated systematic differences between waveshapes of averaged evoked potentials according to hues of eliciting stimuli. These data also counterindicated the involvement of colour perception in the genetic variations of colour preference. However, no significant differences between waveshapes were found in relation to genetic variations in preferences.     

Variation in pollinator preference between two Ipomopsis contact sites that differ in hybridization rate

Pollinator-mediated reproductive isolation is often a principal factor in determining the rate of hybridization between plant species. Pollinator preference and constancy can reduce interspecific pollen transfer between otherwise interfertile, coflowering species. The importance of this ethological isolation can be assessed by comparing the strength of preference and constancy of pollinators in contact sites that differ in the frequency of hybrid individuals. We observed visitation by hummingbirds and hawkmoths in natural single-species patches and artificial mixed-species arrays in two Ipomopsis aggregata/I. tenuituba contact sites-one with few hybrids, and one in which hybrids are abundant. Pollinator preference and constancy were stronger at the low-frequency hybrid site, especially for hawkmoths (Hyles lineata). Hawkmoths at the low-frequency hybrid site showed significant preference and constancy for I. tenuituba, while at the high-frequency site hawkmoths visited both species equally. One hypothesis that might explain these differences in hawkmoth foraging is that warmer nights at the low-frequency hybrid site allow for nocturnal foraging where the light-colored corollas of I. tenuituba have a visibility advantage. These differences in hawkmoth behavior might in turn affect hummingbirds differently at the two sites, through changes in nectar resources, leading to greater pollinator-mediated isolation at the low-frequency hybrid site. Our results suggest that differences in pollinator behaviors between sites can have both direct and indirect effects on hybridization rates between plant species.     

Innate and learned components of human visual preference.

BACKGROUND: Recent claims in neuroscience and evolutionary biology suggest that the aesthetic sense reflects preferences for image signals whose characteristics best fit innate brain mechanisms of visual recognition. RESULTS: This hypothesis was tested by behaviourally measuring, for a set of initially unfamiliar images, the effects of category learning on preference judgements by humans, and by relating the observed data to computationally reconstructed internal representations of categorical concepts. Category learning induced complex shifts in preference behaviour. Two distinct factors - complexity and bilateral symmetry - could be identified from the data as determinants of preference judgements. The effect of the complexity factor varied with object knowledge acquired through category learning. In contrast, the impact of the symmetry factor proved to be unaffected by learning experience. Computer simulations suggested that the preference for pattern complexity relies on active (top-down) mechanisms of visual recognition, whereas the preference for pattern symmetry depends on automatic (bottom-up) mechanisms. CONCLUSIONS: Human visual preferences are not fully determined by (objective) structural regularities of image stimuli but also depend on their learned (subjective) interpretation. These two aspects are reflected in distinct complementary factors underlying preference judgements, and may be related to complementary modes of visual processing in the brain.     

Assessing the applicability of fuzzy neural networks for habitat preference evaluation of Japanese medaka (Oryzias latipes)

Species–environment relationships are key information for the development of planning and management strategies for conservation or restoration of ecosystems. Artificial neural networks (ANNs) are one widely applied type of species distribution model (SDM). Fuzzy neural networks (FNNs), that is, fuzzified ANNs, have been introduced to take into account the uncertainties inherent in fish behaviour and errors in input data. Despite their high predictive ability in modelling complex systems, FNNs cannot describe habitat preference curves (HPCs), although these are the basis for habitat quality assessment. The present study therefore aimed to evaluate the applicability of FNNs for modelling habitat preference and spatial distributions of Japanese medaka (Oryzias latipes), one of the most common freshwater fish in Japan. Three independent data sets were collected during a series of field surveys and used for model development and evaluation of FNNs. A weight decay backpropagation algorithm was additionally introduced, and its effects on the FNNs were evaluated on the basis of model performance and habitat preference information retrieved from the field observation data. Modified sensitivity analysis was applied to derive HPCs of the target fish. Application of weight decay backpropagation markedly reduced the variability of the model structures, improved the generalization ability of the FNNs, and resulted in well-converged and consistent HPCs that were similar to those evaluated by fuzzy habitat preference models. These results support the applicability of FNNs to habitat preference modelling, which can provide useful information on the habitat use by the target fish. Further study should focus on the effects of sources of uncertainty, such as zero abundance, on the SDMs and the resulting habitat preference evaluation.     

Aesthetic preference recognition of 3D shapes using EEG

Recognition and identification of aesthetic preference is indispensable in industrial design. Humans tend to pursue products with aesthetic values and make buying decisions based on their aesthetic preferences. The existence of neuromarketing is to understand consumer responses toward marketing stimuli by using imaging techniques and recognition of physiological parameters. Numerous studies have been done to understand the relationship between human, art and aesthetics. In this paper, we present a novel preference-based measurement of user aesthetics using electroencephalogram (EEG) signals for virtual 3D shapes with motion. The 3D shapes are designed to appear like bracelets, which is generated by using the Gielis superformula. EEG signals were collected by using a medical grade device, the B-Alert X10 from advance brain monitoring, with a sampling frequency of 256 Hz and resolution of 16 bits. The signals obtained when viewing 3D bracelet shapes were decomposed into alpha, beta, theta, gamma and delta rhythm by using time–frequency analysis, then classified into two classes, namely like and dislike by using support vector machines and K-nearest neighbors (KNN) classifiers respectively. Classification accuracy of up to 80 % was obtained by using KNN with the alpha, theta and delta rhythms as the features extracted from frontal channels, Fz, F3 and F4 to classify two classes, like and dislike.     

Tuned solutions in dynamic neural fields as building blocks for extended EEG models

The most prominent functional property of cortical neurons in sensory areas are their tuned receptive fields which provide specific responses of the neurons to external stimuli. Tuned neural firing indeed reflects the most basic and best worked out level of cognitive representations. Tuning properties can be dynamic on a short time-scale of fractions of a second. Such dynamic effects have been modeled by localised solutions (also called “bumps” or “peaks”) in dynamic neural fields. In the present work we develop an approximation method to reduce the dynamics of localised activation peaks in systems of n coupled nonlinear d-dimensional neural fields with transmission delays to a small set of delay differential equations for the peak amplitudes and widths only. The method considerably simplifies the analysis of peaked solutions as demonstrated for a two-dimensional example model of neural feature selectivity in the brain. The reduced equations describe the effective interaction between pools of local neurons of several (n) classes that participate in shaping the dynamic receptive field responses. To lowest order they resemble neural mass models as they often form the base of EEG-models. Thereby they provide a link between functional small-scale receptive field models and more coarse-grained EEG-models. More specifically, they connect the dynamics in feature-selective cortical microcircuits to the more abstract local elements used in coarse-grained models. However, beside amplitudes the reduced equations also reflect the sharpness of tuning of the activity in a d-dimensional feature space in response to localised stimuli.     

Vasopressin and ethanol preference. I. Effects of vasopressin and the fragment DGAVP on altered ethanol preference in Brattleboro diabetes insipidus rats

Preference for concentrations of ethanol between 2.2 and 10 percent versus tap water was studied in Brattleboro rats homozygous for diabetes insipidus (di/di), heterozygous (di/+) or normal (+/+). The di/di rats, totally lacking in vasopressin, had greatly reduced preference scores for all concentrations of ethanol. Their intake of ethanol (g/day) was higher than heterozygotes or normals, but only when 2.2 percent ethanol was offered as a choice. Administration of lysine vasopressin or the vasopressin fragment des-9-Glycinamide-[Arginine8] vasopressin (DGAVP) using osmotic minipumps enhanced ethanol preference scores, reduced ethanol (g/day) intake, and restored total daily fluid intake in di/di rats. When di/di and di/+ rats were first allowed to develop stable ethanol preference before treatment with DGAVP, the peptide had no effect on preference scores. Thus, no treatment was effective in dissociating polydipsia from reduced ethanol preference and increased ethanol intake. While these results cannot exclude a possible regulatory role for endogenous vasopressin in ethanol preference drinking, they more strongly suggest that reduced preference for ethanol and increased ethanol intake are epiphenomena secondary to a polydipsic state.     

Hummingbird color preference within a natural hybrid population of Mimulus aurantiacus (Phrymaceae)

Hummingbird flowers are typically red in color but the reasons for this are not well understood. Relatively few studies have examined hummingbird flower color preferences under natural conditions in which flower color varies within a species. We recorded hummingbird visitation rates to flowers that vary in color from yellow to red in a natural hybrid population between red‐ and yellow‐flowered Mimulus aurantiacus subspecies. We also examined whether there were any correlations between color and flower size or nectar content. Finally, we reviewed the literature on hummingbird color choice tests using feeders and flowers. There were no correlations in this population between flower color and flower size, nectar volume, or sugar concentration. Nevertheless, hummingbirds undervisited the two most yellow color classes, overvisited orange flowers, and visited the two most red color classes in proportion to their frequency in the population. While Hummingbirds preferred flowers expressing red pigments to those that did not, the flowers with the most red hue were not the most attractive, as has been observed in similar studies with other species of Mimulus. While feeder studies generally fail to show hummingbird preference for red, all studies using flowers, including those that control all floral traits other than color, find consistent preference for red. Experiments are suggested that might help disentangle hypotheses for why hummingbirds exhibit this preference.     

Towards a framework for the study of the neural correlates of aesthetic preference

Aiming to provide a tentative framework for the study of the neural correlates of aesthetic preference, we review three recent neuroimaging studies carried out with the purpose of locating brain activity associated with decisions about the beauty of visual stimuli (Cela-Conde et al., 2004; Kawabata and Zeki, 2004; Vartanian and Goel, 2004). We find that the results of the three studies are not in line with previous neuropsychological data. Moreover, there are no coincidences among their results. However, when they are mapped on to Chatterjee's (2003) neuropsychological model of aesthetic preference it becomes clear that neuroimaging data are not contradictory, but complementary, and their interpretation is enriched. The results of these studies suggest that affective processes have an important role in aesthetic preference, and that they are integrated with cognitive processes to reach a decision regarding the beauty of visual stimuli. Future studies must aim to clarify whether certain methodological procedures are better suited to study any of the particular cognitive operations involved in aesthetic preference, and ascertain the extent to which the proposed framework is compatible with the aesthetic appreciation of musical stimuli.     

How We Choose One over Another: Predicting Trial-by-Trial Preference Decision

Preference formation is a complex problem as it is subjective, involves emotion, is led by implicit processes, and changes depending on the context even within the same individual. Thus, scientific attempts to predict preference are challenging, yet quite important for basic understanding of human decision making mechanisms, but prediction in a group-average sense has only a limited significance. In this study, we predicted preferential decisions on a trial by trial basis based on brain responses occurring before the individuals made their decisions explicit. Participants made a binary preference decision of approachability based on faces while their electrophysiological responses were recorded. An artificial neural network based pattern-classifier was used with time-frequency resolved patterns of a functional connectivity measure as features for the classifier. We were able to predict preference decisions with a mean accuracy of 74.3±2.79% at participant-independent level and of 91.4±3.8% at participant-dependent level. Further, we revealed a causal role of the first impression on final decision and demonstrated the temporal trajectory of preference decision formation.     

Free-choice preference under uncertainty

Preferences in pigeons for free choice over forced choice under uncertain contingencies were compared with the one under certain contingencies in multiple concurrent-chain schedules of reinforcement. The uncertain condition examined the preference for two alternatives over one alternative when reinforcement probability at the end of the terminal link equalled 0.5, and with all keys in each terminal link lit green (two mixed fixed-interval extinction keys versus one mixed fixed-interval extinction key). Key and schedule arrangement in the certain condition was the same except that a peck on any terminal-link key after the FI interval always produced food. When naive pigeons were first exposed to uncertain contingencies, preference for two lit keys over one lit key was observed, and the preference was confirmed by sequential reversals of the terminal-link contingencies. However, no consistent preference was observed when uncertain condition followed the certain condition. Under certain contingencies, unlike the earlier experiments, very small and inconsistent preferences for free choice were demonstrated. A possible reason for the different preferences in the uncertain conditions was that pigeons may lessen their sensitivity to the circumstances with uncertainty by any history or carry-over effect of the prior contingency.     

The universal fuzzy logical framework of neural circuits and its application in modeling primary visual cortex

Analytical study of large-scale nonlinear neural circuits is a difficult task. Here we analyze the function of neural systems by probing the fuzzy logical framework of the neural cells’ dynamical equations. Although there is a close relation between the theories of fuzzy logical systems and neural systems and many papers investigate this subject, most investigations focus on finding new functions of neural systems by hybridizing fuzzy logical and neural system. In this paper, the fuzzy logical framework of neural cells is used to understand the nonlinear dynamic attributes of a common neural system by abstracting the fuzzy logical framework of a neural cell. Our analysis enables the educated design of network models for classes of computation. As an example, a recurrent network model of the primary visual cortex has been built and tested using this approach.