The actions of others act as a pseudo-reward to drive imitation in the context of social reinforcement learning

While there is no doubt that social signals affect human reinforcement learning, there is still no consensus about how this process is computationally implemented. To address this issue, we compared three psychologically plausible hypotheses about the algorithmic implementation of imitation in reinforcement learning. The first hypothesis, decision biasing (DB), postulates that imitation consists in transiently biasing the learner’s action selection without affecting their value function. According to the second hypothesis, model-based imitation (MB), the learner infers the demonstrator’s value function through inverse reinforcement learning and uses it to bias action selection. Finally, according to the third hypothesis, value shaping (VS), the demonstrator’s actions directly affect the learner’s value function. We tested these three hypotheses in 2 experiments (N = 24 and N = 44) featuring a new variant of a social reinforcement learning task. We show through model comparison and model simulation that VS provides the best explanation of learner’s behavior. Results replicated in a third independent experiment featuring a larger cohort and a different design (N = 302). In our experiments, we also manipulated the quality of the demonstrators’ choices and found that learners were able to adapt their imitation rate, so that only skilled demonstrators were imitated. We proposed and tested an efficient meta-learning process to account for this effect, where imitation is regulated by the agreement between the learner and the demonstrator. In sum, our findings provide new insights and perspectives on the computational mechanisms underlying adaptive imitation in human reinforcement learning.

This study investigates imitation from a computational perspective; three experiments show that, in the context of reinforcement learning, imitation operates via a durable modification of the learner''s values, shedding new light on how imitation is computationally implemented and shapes learning and decision-making.     

A locust witness of a trans-oceanic Oligocene migration between Arabia and Iran (Orthoptera: Acrididae)

Fossil insects are very rarely found in sediments of deep marine origin. Nevertheless they can be of great interest to trace past events such as trans-oceanic migrations. Here we document the first fossil insects from Iran, viz. several alate ants dead during mating swarms and a migratory locust, found in the pelagic Oligocene sediments of the Zagros Mountains. This locust represents the first putative indication of insect migrations between the Arabian-African and Asiatic continents through the Parathetys, probably in relation with the development of open grassland biotas in these areas.     

Comparative inflorescence and floral ontogeny in the genus Mentha (Mentheae: Nepetoideae: Lamiaceae): variable sequences of organ appearance and random petal aestivation

The genus Mentha is a taxonomically complex genus, characterized by large morphological variations. Only a few, frequently overlapping, characters are of value in taxonomy. Comparative floral developmental studies provide an opportunity for better understanding the systematic relationships among different species. The inflorescence and floral ontogeny of three Mentha L. species (M. piperita L., M. pulegium L. and M. suaveolens Ehrh.) were investigated using epi-illumination light microscopy. All three species studied have thyrses with the same developmental pathway. The lack of higher order bracts and the monochasial branching of the higher order inflorescence apices were found as special features of inflorescence ontogeny. Sepals appear unidirectionally from the adaxial side in all except for M. pulegium which shows a modified unidirectional sequence. Variable sequences of petal and stamen appearance from unidirectional to reversed unidirectional sequence are present in all. Significant ontogenetic features include (1) appearance of the corolla as a rim before petal lobes become visible and (2) instability in petal aestivation. Morphological features including densely hairy calyx, five-lobed corolla tube, smaller adaxial stamens and hairy ovary with included style distinguish M. pulegium from the other species. On the basis of our results floral ontogenetic features could be considered important characters for delimiting or diagnosing different sections in the genus Mentha. Variable sequences of petal lobe appearance and instability in petal aestivation were found as unusual developmental characters.     

A preparative high performance liquid chromatography method for separation of lecithin: comparison to thin-layer chromatography

We have developed a high performance liquid chromatography (HPLC) method to separate lecithin from other phospholipid classes and to obtain lecithin from biologic materials. The separation was performed on a preparative 10-micron Spherisorb column with an optimized solvent system consisting of the following components: acetonitrile, isopropanol, methanol, water, and trifluoroacetic acid. The advantages of this method are the use of an isocratic solvent system limited to about 30 min and the very good separation of the phosphatidyl-choline fraction from the sphingomyelin fraction. Furthermore, the HPLC method has a better recovery rate than the thin-layer chromatography method, and it can be run under automatic control.     

A cross-linked anti-TNF-α aptamer for neutralization of TNF-α-induced cutaneous Shwartzman phenomenon: A simple and novel approach for improving aptamers' affinity and efficiency

To increase the efficiency of aptamers to their targets, a simple and novel method has been developed based on aptamer oligomerization. To this purpose, previously anti-human TNF-α aptamer named T1–T4 was trimerized through a trimethyl aconitate core for neutralization of in vitro and in vivo of TNF-α. At first, 54 mer T1–T4 aptamers with 5′-NH₂ groups were covalently coupled to three ester residues in the trimethyl aconitate. In vitro activity of novel anti-TNF-α aptamer and its dissociation constant (K_d) was done using the L929 cell cytotoxicity assay. In vivo anti-TNF-α activity of new oligomerized aptamer was assessed in a mouse model of cutaneous Shwartzman. Anchoring of three T1–T4 aptamers to trimethyl aconitate substituent results in formation of the 162 mer fragment, which was well revealed by gel electrophoresis. In vitro study indicated that the trimerization of T1–T4 aptamer significantly improved its anti-TNF-α activity compared to non-modified aptamers (P < 0.0001) from 40% to 60%. The determination of K_d showed that trimerization could effectively enhance K_d of aptamer from 67 nM to 36 nM. In vivo study showed that trimer aptamer markedly reduced mean scar size from 15.2 ± 1.2 mm to 1.6 ± 0.1 mm (P < 0.0001), which prevent the formation of skin lesions. In vitro and in vivo studies indicate that trimerization of anti-TNF-α aptamer with a novel approach could improve the anti-TNF-α activity and therapeutic efficacy. According to our findings, a new anti-TNF-α aptamer described here could be considered an appropriate therapeutic agent in treating several inflammatory diseases.     

Molecular dynamic simulations of nanomechanic chaperone peptide and effects of in silico His mutations on nanostructured function

The nanoscale peptide YSGVCHTDLHAWHGDWPLPVK exhibits molecular chaperone activity and prevents protein aggregation under chemical and/or thermal stress. Here, His mutations of this peptide and their impact on chaperone activity were evaluated using theoretical techniques. Molecular dynamic (MD) simulations with simulated annealing (SA) of different mutant nanopeptides were employed to determine the contribution of the scaffolding His residues (H45, H49, H52), when mutated to Pro, on chaperone action in vitro. The in silico mutations of His residues to Pro (H45P, H49P, H52P) revealed loss of secondary ordered strand structure. However, a small part of the strand conformation was formed in the middle region of the native chaperone peptide. The His‐to‐Pro mutations resulted in decreased gyration radius (R_g) values and surface accessibility of the mutant peptides under the simulation times. The invariant dihedral angle (ϕ) values and the disrupting effects of the Pro residues indicated the coil conformation of mutant peptides. The failure of the chaperone‐like action in the Pro mutant peptides was consistent with their decreased effective accessible surfaces. The high variation of Φ value for His residues in native chaperone peptide leads to high flexibility, such as a minichaperone acting as a nanomachine at the molecular level. Our findings demonstrate that the peptide strand conformation motif with high flexibility at nanoscale is critical for chaperone activity. Copyright © 2008 European Peptide Society and John Wiley & Sons, Ltd.     

Bacterial infections in the early period after liver transplantation in adults: A prospective single-center cohort study

Liver transplantation (LT) is a potentially curative treatment for terminal stage hepatic diseases. Bacterial infections are the main causes of mortality and morbidity in the early period after LT. Identifying the risk factors could help in minimizing their development. We prospectively investigated the incidence, characteristics, and risk factors of bacterial infections among the recipients during hospitalization after LT and assigned a predictive score. All 389 consecutive adults who underwent LT at the main referral hospital of LT in Iran during 1 year were enrolled prospectively in a cohort study. Infection group consisted of 143 recipients (36.8%). Urinary tract and surgical site infections were the most frequent ones. Gram-negative bacteria were more prevalent than Gram-positive ones. Independent risk factors were female sex (relative risks = 2.13), age ≤ 43.5 years (3.70), hospital stay ≥ 9.5 days (5.22), abdominal reoperation (3.03), vancomycin-resistant Enterococci colonization (5.52), hospitalization 3 months prior to LT (3.25), mechanical ventilation ≥48 hr (4.93), and renal replacement therapies (13.40). We developed a risk score for the prediction of bacterial infections with an area under the receiver operating characteristic curve of 0.85 (95% CI, 0.81–0.89) with sensitivity of 88% and specificity of 64%. In the infection group, mortality was higher than in controls (18.9% vs. 2.0%) with longer hospitalization (16 vs. 10 days; P < 0.001). We detected a high rate of bacterial infections leading to longer hospital stay and higher mortality rate. The formulated risk score can help predict bacterial infections; however, it requires clinical validation in further studies.     

Endochondral ossification of costal cartilage is arrested after chondrocytes have reached hypertrophic stage of late differentiation

Late cartilage differentiation during endochondral bone formation is a multistep process. Chondrocytes transit through a differentiation cascade under the direction of environmental signals that either stimulate or repress progression from one step to the next. In human costal cartilage, chondrocytes reach very advanced stages of late differentiation and express collagen X. However, remodeling of the tissue into bone is strongly repressed. The second hypertrophy marker, alkaline phosphatase, is not expressed before puberty. Upon sexual maturity, both alkaline phosphatase and collagen X activity levels are increased and slow ossification takes place. Thus, the expression of the two hypertrophy markers is widely separated in time in costal cartilage. Progression of endochondral ossification in this tissue beyond the stage of hypertrophic cartilage appears to be associated with the expression of alkaline phosphatase activity. Costal chondrocytes in culture are stimulated by parathyroid hormone in a PTH/PTHrP receptor-mediated manner to express the fully differentiated hypertrophic phenotype. In addition, the hormone stimulates hypertrophic development even more powerfully through its carboxyterminal domain, presumably by interaction with receptors distinct from PTH/PTHrP receptors. Therefore, PTH can support late cartilage differentiation at very advanced stages, whereas the same signal negatively controls the process at earlier stages.