Uniform Local Binary Pattern Based Texture-Edge Feature for 3D Human Behavior Recognition

With the rapid development of 3D somatosensory technology, human behavior recognition has become an important research field. Human behavior feature analysis has evolved from traditional 2D features to 3D features. In order to improve the performance of human activity recognition, a human behavior recognition method is proposed, which is based on a hybrid texture-edge local pattern coding feature extraction and integration of RGB and depth videos information. The paper mainly focuses on background subtraction on RGB and depth video sequences of behaviors, extracting and integrating historical images of the behavior outlines, feature extraction and classification. The new method of 3D human behavior recognition has achieved the rapid and efficient recognition of behavior videos. A large number of experiments show that the proposed method has faster speed and higher recognition rate. The recognition method has good robustness for different environmental colors, lightings and other factors. Meanwhile, the feature of mixed texture-edge uniform local binary pattern can be used in most 3D behavior recognition.     

Polymer gel dosimeters for pretreatment radiotherapy verification using the three-dimensional gamma evaluation and pass rate maps

Polymer gel dosimeters (PGDs) have been widely studied for use in the pretreatment verification of clinical radiation therapy. However, the readability of PGDs in three-dimensional (3D) dosimetry remain unclear. In this study, the pretreatment verifications of clinical radiation therapy were performed using an N-isopropyl-acrylamide (NIPAM) PGD, and the results were used to evaluate the performance of the NIPAM PGD on 3D dose measurement. A gel phantom was used to measure the dose distribution of a clinical case of intensity-modulated radiation therapy. Magnetic resonance imaging scans were performed for dose readouts. The measured dose volumes were compared with the planned dose volume. The relative volume histograms showed that relative volumes with a negative percent dose difference decreased as time elapsed. Furthermore, the histograms revealed few changes after 24 h postirradiation. For the 3%/3 mm and 2%/2 mm criteria, the pass rates of the 12- and 24-h dose volumes were higher than 95%, respectively. This study thus concludes that the pass rate map can be used to evaluate the dose-temporal readability of PGDs and that the NIPAM PGD can be used for clinical pretreatment verifications.     

A 3-D dynamic model of human finger for studying free movements.

The purpose of this work is to develop a 3D inverse dynamic model of the human finger for estimating the muscular forces involved during free finger movements. A review of the existing 3D models of the fingers is presented, and an alternative one is proposed. The validity of the model has been proved by means of two simulations: free flexion-extension motion of all joints, and free metacarpophalangeal (MCP) adduction motion. The simulation shows the need for a dynamic model including inertial effects when studying fast movements and the relevance of modelling passive forces generated by the structures studying free movements, such as the force exerted by the muscles when they are stretched and the passive action of the ligaments over the MCP joint in order to reproduce the muscular force pattern during the simulation of the free MCP abduction-adduction movements.     

Trajectory Data Analyses for Pedestrian Space-time Activity Study

It is well recognized that human movement in the spatial and temporal dimensions has direct influence on disease transmission^1-3. An infectious disease typically spreads via contact between infected and susceptible individuals in their overlapped activity spaces. Therefore, daily mobility-activity information can be used as an indicator to measure exposures to risk factors of infection. However, a major difficulty and thus the reason for paucity of studies of infectious disease transmission at the micro scale arise from the lack of detailed individual mobility data. Previously in transportation and tourism research detailed space-time activity data often relied on the time-space diary technique, which requires subjects to actively record their activities in time and space. This is highly demanding for the participants and collaboration from the participants greatly affects the quality of data⁴.Modern technologies such as GPS and mobile communications have made possible the automatic collection of trajectory data. The data collected, however, is not ideal for modeling human space-time activities, limited by the accuracies of existing devices. There is also no readily available tool for efficient processing of the data for human behavior study. We present here a suite of methods and an integrated ArcGIS desktop-based visual interface for the pre-processing and spatiotemporal analyses of trajectory data. We provide examples of how such processing may be used to model human space-time activities, especially with error-rich pedestrian trajectory data, that could be useful in public health studies such as infectious disease transmission modeling.The procedure presented includes pre-processing, trajectory segmentation, activity space characterization, density estimation and visualization, and a few other exploratory analysis methods. Pre-processing is the cleaning of noisy raw trajectory data. We introduce an interactive visual pre-processing interface as well as an automatic module. Trajectory segmentation⁵ involves the identification of indoor and outdoor parts from pre-processed space-time tracks. Again, both interactive visual segmentation and automatic segmentation are supported. Segmented space-time tracks are then analyzed to derive characteristics of one''s activity space such as activity radius etc. Density estimation and visualization are used to examine large amount of trajectory data to model hot spots and interactions. We demonstrate both density surface mapping⁶ and density volume rendering⁷. We also include a couple of other exploratory data analyses (EDA) and visualizations tools, such as Google Earth animation support and connection analysis. The suite of analytical as well as visual methods presented in this paper may be applied to any trajectory data for space-time activity studies.     

Learning Low-Rank Class-Specific Dictionary and Sparse Intra-Class Variant Dictionary for Face Recognition

Face recognition is challenging especially when the images from different persons are similar to each other due to variations in illumination, expression, and occlusion. If we have sufficient training images of each person which can span the facial variations of that person under testing conditions, sparse representation based classification (SRC) achieves very promising results. However, in many applications, face recognition often encounters the small sample size problem arising from the small number of available training images for each person. In this paper, we present a novel face recognition framework by utilizing low-rank and sparse error matrix decomposition, and sparse coding techniques (LRSE+SC). Firstly, the low-rank matrix recovery technique is applied to decompose the face images per class into a low-rank matrix and a sparse error matrix. The low-rank matrix of each individual is a class-specific dictionary and it captures the discriminative feature of this individual. The sparse error matrix represents the intra-class variations, such as illumination, expression changes. Secondly, we combine the low-rank part (representative basis) of each person into a supervised dictionary and integrate all the sparse error matrix of each individual into a within-individual variant dictionary which can be applied to represent the possible variations between the testing and training images. Then these two dictionaries are used to code the query image. The within-individual variant dictionary can be shared by all the subjects and only contribute to explain the lighting conditions, expressions, and occlusions of the query image rather than discrimination. At last, a reconstruction-based scheme is adopted for face recognition. Since the within-individual dictionary is introduced, LRSE+SC can handle the problem of the corrupted training data and the situation that not all subjects have enough samples for training. Experimental results show that our method achieves the state-of-the-art results on AR, FERET, FRGC and LFW databases.     

New least squares solutions for estimating the average centre of rotation and the axis of rotation.

A new method is proposed for estimating the parameters of ball joints, also known as spherical or revolute joints and hinge joints with a fixed axis of rotation. The method does not require manual adjustment of any optimisation parameters and produces closed form solutions. It is a least squares solution using the whole 3D motion data set. We do not assume strict rigidity but only that the markers maintain a constant distance from the centre or axis of rotation. This method is compared with other methods that use similar assumptions in the cases of random measurement errors, systematic skin movements and skin movements with random measurement noise. Simulation results indicate that the new method is superior in terms of the algorithm used, the closure of the solution, consistency and minimal manual parameter adjustment. The method can also be adapted to joints with translational movements.     

The importance of residues in substrate recognition site 3 for the catalytic function of CYP2D25 (vitamin D 25-hydroxylase).

Porcine CYP2D25, microsomal vitamin D(3) 25-hydroxylase, catalyzes the essential first step in the bioactivation of the prohormone vitamin D(3). Although CYP2D25 shows a high degree of sequence identity with other members of the CYP2D subfamily, such as human CYP2D6, the vitamin D(3) 25-hydroxylase activity is a unique property among CYP2D enzymes. In addition to 25-hydroxylation, CYP2D25 also metabolizes the drug tolterodine. In this study, CYP2D25 was functionally expressed in the Saccharomyces cerevisiae W(R) strain and site-directed mutagenesis was used to study the role of substrate recognition site 3 (SRS-3) for the catalytic specificity of CYP2D25. Five residues in SRS-3 of CYP2D25 were simultaneously mutated to the equivalent residues in CYP2D6, an enzyme not active in 25-hydroxylation. Western blot analysis of microsomes from transformed yeast cells showed that both the wild-type and mutant CYP2D25 were expressed at comparable levels. The 25-hydroxylase activity of recombinant mutant CYP2D25 was completely lost whereas the activity toward tolterodine remained virtually unaffected. The results implicate that residues in SRS-3 of CYP2D25 are important determinants for its function in vitamin D(3) metabolism.     

Activation of interlimb interactions increases the motor output in legs of healthy subjects: Study under the conditions of arm and leg unloading

The effect of arm movements and movements of individual arm joints on the electrophysiological and kinematic characteristics of voluntary and vibration-triggered stepping-like leg movements was studied under the conditions of horizontal support of the upper and lower limbs. The horizontal support of arms provided a significant increase in the rate of activation of locomotor automatism by noninvasive impact on tonic sensory inputs. The addition of active arm movements during involuntary stepping-like leg movements led to an increase in the EMG activity of hip muscles and was accompanied by an increase in the amplitude of hip and shin movements. The movement of the shoulder joints led to an increase in the activity of hip muscles and was accompanied by an increase in the amplitude of hip and shin movements. Passive arm movements had the same effect on induced leg movements. The movement of the shoulder joints led to an increase in the activity of hip muscles and an increase in the amplitude of movements of knee and hip joints. At the same time, the movement of forearms and wrists had a similar facilitating effect on the physiological and kinematic characteristics of rhythmic stepping-like movements, but influenced the distal segments of legs to a greater extent. Under the conditions of subthreshold vibration of leg muscles, voluntary arm movements led to activation of involuntary rhythmic stepping movements. During voluntary leg movements, the addition of arm movements had a significantly smaller impact on the parameters of rhythmic stepping than during involuntary leg movements. Thus, the simultaneous movements of the upper and lower limbs are an effective method of activation of neural networks connecting the rhythm generators of arms and legs. Under the conditions of arm and leg unloading, the interactions between the cervical and lumbosacral segments of the spinal cord seem to play the major role in the impact of arm movements on the patterns of leg movements. The described methods of activation of interlimb interactions can be used in the rehabilitation of post-stroke patients and patients with spinal cord injuries, Parkinson’s disease, and other neurological diseases.     

The investigation of control mechanisms of stepping rhythm in human in the air-stepping conditions during passive and voluntary leg movements

In unloading condition the degree of activation of the central stepping program was investigated during passive leg movements in healthy subjects, as well as the excitability of spinal motoneurons during passive and voluntary stepping movement. Passive stepping movements with characteristics maximally approximated to those during voluntary stepping were accomplished by experimenter. The comparison of the muscle activity bursts during voluntary and imposed movements was made. In addition to that the influence of artificially created loading onto the foot to the leg movement characteristics was analyzed. Spinal motoneuron excitability was estimated by means of evaluation of amplitude modulation of the soleus H-reflex. The changes of H-reflexes under the fixation of knee or hip joints were also studied. In majority of subjects the passive movements were accompanied by bursts of EMG activity of hip muscles (and sometimes of knee muscles), which timing during step cycle was coincided with burst timing of voluntary step cycle. In many cases the bursts of EMG activity during passive movements exceeded activity in homonymous muscles during voluntary stepping. The foot loading imitation exerted essential influence on distal parts of moving extremity during voluntary as well passive movements, that was expressed in the appearance of movements in the ankle joint and accompanied by emergence and increasing of phasic EMG activity of shank muscles. The excitability of motoneurons during passive movements was greater then during voluntary ones. The changes and modulation of H-reflex throughout the step cycle without restriction of joint mobility and during exclusion of hip joint mobility were similar. The knee joint fixation exerted the greater influence. It is supposed that imposed movements activate the same mechanisms of rhythm generation as a supraspinal commands during voluntary movements. In the conditions of passive movements the presynaptic inhibition depend on afferent influences from moving leg in the most degree then on central commands. It seems that afferent inputs from pressure receptors of foot in the condition of "air-stepping" actively interact with central program of stepping and, irrespective of type of the performing movements (voluntary or passive), form the final pattern activity.     

Imaging cellular network dynamics in three dimensions using fast 3D laser scanning

Spatiotemporal activity patterns in three-dimensionally organized cellular networks are fundamental to the function of the nervous system. Despite advances in functional imaging of cell populations, a method to resolve local network activity in three dimensions has been lacking. Here we introduce a three-dimensional (3D) line-scan technology for two-photon microscopy that permits fast fluorescence measurements from several hundred cells distributed in 3D space. We combined sinusoidal vibration of the microscope objective at 10 Hz with 'smart' movements of galvanometric x-y scanners to repeatedly scan the laser focus along a closed 3D trajectory. More than 90% of cell somata were sampled by the scan line within volumes of 250 microm side length. Using bulk-loading of calcium indicator, we applied this method to reveal spatiotemporal activity patterns in neuronal and astrocytic networks in the rat neocortex in vivo. Two-photon population imaging using 3D scanning opens the field for comprehensive studies of local network dynamics in intact tissue.     

Structural correlates of forelimb function in fur seals and sea lions

Dissections, manipulation of ligamentary preparations, analysis of limb proportions, and quantitative aspects of forelimb myology are used to correlate forelimb morphology in fur seals and sea lions (sub-family Otariinae) with previously published data as to their locomotor function (English, '76a). Comparisons to structure and function in generalized fissiped carnivores are then used to elucidate locomotor adaptations in fur seals and sea lions. Unique features of forelimb function during swimming in these pinnipeds include the amounts of abduction-adduction and rotary movements used. Modifications of the size, attachments and fascicle architecture of the muscles and the structure and range of possible movement of the joints suggest that in fur seals and sea lions these movements (1) take place about the glenohumeral (shoulder) joints, (2) that the movements are probably finely controlled, and (3) that they contribute to the generation of massive forward thrust via the cooperative activity of muscles capable of generating large amounts of force throughout the range of movement. Recovery movements occur through a similarly large range, and modifications of forelimb anatomy either to minimize or overcome water resistance are noted. The adaptive significance of these modifications is interpreted as allowing fur seals and sea lions to swim at speeds necessary to feed on the fast swimming prey presumably abundant in their adaptive zone.     

Anchor-chain molecular system for orientation control in enzyme immobilization

An anchor-chain molecular system was constructed for controlled orientation and high activity in enzyme immobilization. A streptavidin recognition peptide (streptag) coding sequence was fused to the 3' end of the phoA gene, which codes for E. coli alkaline phosphatase (EAP). Both the wild-type (WT) and the Asp-101 --> Ser (D1O1S) mutant were modified with the streptag sequence with or without the insertion of a flexible linker peptide [-(Gly-Ser)(5)-] coding sequence. The fused genes were cloned into the vector pASK75 and expressed in the periplasm of the host cell Escherichia coli SM547. The proteins were released by osmotic shock and purified by ion-exchange chromatography. Enzyme activities of all proteins were measured spectrophotometrically with rho-nitrophenyl phosphate as the substrate. Specific activities of D101S-streptag and D101S-linker-streptag enzymes were increased 25- or 34-fold over the WT, respectively. These fusion proteins were then immobilized on microtiter plates through streptag-streptavidin binding reaction. After immobilization, the D101S-linker-streptag enzyme displayed the highest residual activity and the ratio of enzyme activities of the linker to nonlinker enzymes was 8.4. These results show that the addition of a linker peptide provides a spacer so as to minimize steric hindrance between the enzyme and streptavidin. The method provides a solution for controlled enzyme immobilization with high recover activity, which is especially important in construction of biosensors, biochips, or other biodevices.     

Serum Amyloid P Is a Sialylated Glycoprotein Inhibitor of Influenza A Viruses

Members of the pentraxin family, including PTX3 and serum amyloid P component (SAP), have been reported to play a role in innate host defence against a range of microbial pathogens, yet little is known regarding their antiviral activities. In this study, we demonstrate that human SAP binds to human influenza A virus (IAV) strains and mediates a range of antiviral activities, including inhibition of IAV-induced hemagglutination (HA), neutralization of virus infectivity and inhibition of the enzymatic activity of the viral neuraminidase (NA). Characterization of the anti-IAV activity of SAP after periodate or bacterial sialidase treatment demonstrated that α(2,6)-linked sialic acid residues on the glycosidic moiety of SAP are critical for recognition by the HA of susceptible IAV strains. Other proteins of the innate immune system, namely human surfactant protein A and porcine surfactant protein D, have been reported to express sialylated glycans which facilitate inhibition of particular IAV strains, yet the specific viral determinants for recognition of these inhibitors have not been defined. Herein, we have selected virus mutants in the presence of human SAP and identified specific residues in the receptor-binding pocket of the viral HA which are critical for recognition and therefore susceptibility to the antiviral activities of SAP. Given the widespread expression of α(2,6)-linked sialic acid in the human respiratory tract, we propose that SAP may act as an effective receptor mimic to limit IAV infection of airway epithelial cells.     

Functional analysis of the shoulder girdle of cats during locomotion

The movements of the shoulder girdle of eight adult cats during overground stepping were studied, using standard slow motion cinematographic techniques. The patterns of activity of shoulder muscles were examined, using simultaneous intramuscular electromyography. Walking, trotting and galloping steps were analyzed from digitized single motion picture frame images. Angular movements of the shoulder girdle consist of biphasic flexion and extension of the shoulder joint and a monophasic flexion-extension alternation of the scapula on the thorax during each step cycle. In addition, the center of the scapula moves craniad during the swing phase and caudad during the stance phase with respect to a fixed reference point on the animal. Similar vertical movements of the center of the scapula also occur in each step cycle. Results of EMG studies of the 17 muscles capable of acting on the shoulder girdle indicate that three overall patterns of activity are found: (1) a pattern typical of extensor muscles, active during all the extension epochs; (2) a pattern typical of flexor muscles, active during the flexion epoch; and (3) a biphasic pattern of activity, active twice in each step. There data are used, along with a re-examination of previous models of the mechanics of the shoulder girdle of carnivores to examine the function and mechanics of shoulder motion. It is concluded that the rotary and translatory movements of the shoulder girdle during stepping combine to enhance step length.     

Regulation of alkane oxidation in Pseudomonas putida.

We have studied the appearance of whole-cell oxidizing activity for n-alkanes and their oxidation products in strains of Pseudomonas putida carrying the OCT plasmid. Our results indicate that the OCT plasmid codes for inducible alkane-hydroxylating and primary alcohol-dehydrogenating activities and that the chromosome codes for constitutive oxidizing activities for primary alcohols, aliphatic aldehydes, and fatty acids. Mutant isolation confirms the presence of an alcohol dehydrogenase locus on the OCT plasmid and indicated the presence of multiple alcohol and aldehyde dehydrogenase loci on the P. putida chromosome. Induction tests with various compounds indicate that inducer recognition has specificity for chain length and can be affected by the degree of oxidation of the carbon chain. Some inducers are neither growth nor respiration substrates. Growth tests with and without a gratuitous inducer indicate that undecane is not a growth substrate because it does not induce alkane hydroxylase activity. Using a growth test for determining induction of the plasmid alcohol dehydrogenase it is possible to show that heptane induces this activity in hydroxylase-negative mutants. This suggests that unoxidized alkane molecules are the physiological inducers of both plasmid activities.     

Peculiarities of Activation of the Upper Limb Muscles in Realization of Two-Joint Movements in Humans

In tests on humans, we recorded EMG activity from the muscles flexing and extending the forearm and shoulder in the course of realization of sequential single-joint and simultaneous two-joint movements of the upper limb. As was shown, the shoulder muscles m. biceps brachii and m. triceps brachii are involved in flexion/extension of both elbow and shoulder joints. Central commands sent to the above muscles in the course of a two-joint movement could be considered a superposition of the central commands coming to the same muscles in realization of the corresponding sequential single-joint movements with the same changes in the angles of the elbow and shoulder joints. External loadings applied in the direction of extension of the elbow and shoulder joints induced, in general, similar changes in coordination of the activity of muscles moving the forearm and shoulder under conditions of both single-joint and two-joint movements. These facts allow us to suppose that coordination of the muscle activity in two-joint movements depends to a greater extent on the forces influencing limb links than on the mode of realization of the movements (two sequential single-joint movements vs a two-joint movement corresponding to the above motor events).     

The effect of the visual context in the recognition of symbolic gestures

Background

To investigate, by means of fMRI, the influence of the visual environment in the process of symbolic gesture recognition. Emblems are semiotic gestures that use movements or hand postures to symbolically encode and communicate meaning, independently of language. They often require contextual information to be correctly understood. Until now, observation of symbolic gestures was studied against a blank background where the meaning and intentionality of the gesture was not fulfilled.

Methodology/Principal Findings

Normal subjects were scanned while observing short videos of an individual performing symbolic gesture with or without the corresponding visual context and the context scenes without gestures. The comparison between gestures regardless of the context demonstrated increased activity in the inferior frontal gyrus, the superior parietal cortex and the temporoparietal junction in the right hemisphere and the precuneus and posterior cingulate bilaterally, while the comparison between context and gestures alone did not recruit any of these regions.

Conclusions/Significance

These areas seem to be crucial for the inference of intentions in symbolic gestures observed in their natural context and represent an interrelated network formed by components of the putative human neuron mirror system as well as the mentalizing system.     

Young children with autism spectrum disorder use predictive eye movements in action observation

Does a dysfunction in the mirror neuron system (MNS) underlie the social symptoms defining autism spectrum disorder (ASD)? Research suggests that the MNS matches observed actions to motor plans for similar actions, and that these motor plans include directions for predictive eye movements when observing goal-directed actions. Thus, one important question is whether children with ASD use predictive eye movements in action observation. Young children with ASD as well as typically developing children and adults were shown videos in which an actor performed object-directed actions (human agent condition). Children with ASD were also shown control videos showing objects moving by themselves (self-propelled condition). Gaze was measured using a corneal reflection technique. Children with ASD and typically developing individuals used strikingly similar goal-directed eye movements when observing others’ actions in the human agent condition. Gaze was reactive in the self-propelled condition, suggesting that prediction is linked to seeing a hand–object interaction. This study does not support the view that ASD is characterized by a global dysfunction in the MNS.     

Sparse incomplete representations: a potential role of olfactory granule cells

Mitral/tufted cells of the olfactory bulb receive odorant information from receptor neurons and transmit this information to the cortex. Studies in awake behaving animals have found that sustained responses of mitral cells to odorants are rare, suggesting sparse combinatorial representation of the odorants. Careful alignment of mitral cell firing with the phase of the respiration cycle revealed brief transient activity in the larger population of mitral cells, which respond to odorants during a small fraction of the respiration cycle. Responses of these cells are therefore temporally sparse. Here, we propose a mathematical model for the olfactory bulb network that can reproduce both combinatorially and temporally sparse mitral cell codes. We argue that sparse codes emerge as a result of the balance between mitral cells' excitatory inputs and inhibition provided by the granule cells. Our model suggests functional significance for the dendrodendritic synapses mediating interactions between mitral and granule cells.