Vision-based force measurement using neural networks for biological cell microinjection

This paper presents a vision-based force measurement method using an artificial neural network model. The proposed model is used for measuring the applied load to a spherical biological cell during micromanipulation process. The devised vision-based method is most useful when force measurement capability is required, but it is very challenging or even infeasible to use a force sensor. Artificial neural networks in conjunction with image processing techniques have been used to estimate the applied load to a cell. A bio-micromanipulation system capable of force measurement has also been established in order to collect the training data required for the proposed neural network model. The geometric characterization of zebrafish embryos membranes has been performed during the penetration of the micropipette prior to piercing. The geometric features are extracted from images using image processing techniques. These features have been used to describe the shape and quantify the deformation of the cell at different indentation depths. The neural network is trained by taking the visual data as the input and the measured corresponding force as the output. Once the neural network is trained with sufficient number of data, it can be used as a precise sensor in bio-micromanipulation setups. However, the proposed neural network model is applicable for indentation of any other spherical elastic object. The results demonstrate the capability of the proposed method. The outcomes of this study could be useful for measuring force in biological cell micromanipulation processes such as injection of the mouse oocyte/embryo.     

Identification of butterfly species with a single neural network system

Growing interest in conservation and biodiversity increased the demand for accurate and consistent identification of biological objects, such as insects, at the level of individual or species. Among the identification issues, butterfly identification at the species level has been strongly addressed because it is directly connected to the crop plants for human food and animal feed products. However, so far, the widely-used reliable methods were not suggested due to the complicated butterfly shape. In the present study, we propose a novel approach based on a back-propagation neural network to identify butterfly species. The neural network system was designed as a multi-class pattern classifier to identify seven different species. We used branch length similarity (BLS) entropies calculated from the boundary pixels of a butterfly shape as the input feature to the neural network. We verified the accuracy and efficiency of our method by comparing its performance to that of another single neural network system in which the binary values (0 or 1) of all pixels on an image shape are used as a feature vector. Experimental results showed that our method outperforms the binary image network in both accuracy and efficiency.     

Face recognition from a single image per person using deep architecture neural networks

Implementing an accurate face recognition system requires images in different variations, and if our database is large, we suffer from problems such as storing cost and low speed in recognition algorithms. On the other hand, in some applications there is only one image available per person for training recognition model. In this article, we propose a neural network model inspired of bidirectional analysis and synthesis brain network which can learn nonlinear mapping between image space and components space. Using a deep neural network model, we have tried to separate pose components from person ones. After setting apart these components, we can use them to synthesis virtual images of test data in different pose and lighting conditions. These virtual images are used to train neural network classifier. The results showed that training neural classifier with virtual images gives better performance than training classifier with frontal view images.     

A neural network model for texture discrimination

A model of texture discrimination in visual cortex was built using a feedforward network with lateral interactions among relatively realistic spiking neural elements. The elements have various membrane currents, equilibrium potentials and time constants, with action potentials and synapses. The model is derived from the modified programs of MacGregor (1987). Gabor-like filters are applied to overlapping regions in the original image; the neural network with lateral excitatory and inhibitory interactions then compares and adjusts the Gabor amplitudes in order to produce the actual texture discrimination. Finally, a combination layer selects and groups various representations in the output of the network to form the final transformed image material. We show that both texture segmentation and detection of texture boundaries can be represented in the firing activity of such a network for a wide variety of synthetic to natural images. Performance details depend most strongly on the global balance of strengths of the excitatory and inhibitory lateral interconnections. The spatial distribution of lateral connective strengths has relatively little effect. Detailed temporal firing activities of single elements in the lateral connected network were examined under various stimulus conditions. Results show (as in area 17 of cortex) that a single element's response to image features local to its receptive field can be altered by changes in the global context.     

A model for integrating elementary neural functions into delayed-response behavior

It is well established that various cortical regions can implement a wide array of neural processes, yet the mechanisms which integrate these processes into behavior-producing, brain-scale activity remain elusive. We propose that an important role in this respect might be played by executive structures controlling the traffic of information between the cortical regions involved. To illustrate this hypothesis, we present a neural network model comprising a set of interconnected structures harboring stimulus-related activity (visual representation, working memory, and planning), and a group of executive units with task-related activity patterns that manage the information flowing between them. The resulting dynamics allows the network to perform the dual task of either retaining an image during a delay (delayed-matching to sample task), or recalling from this image another one that has been associated with it during training (delayed-pair association task). The model reproduces behavioral and electrophysiological data gathered on the inferior temporal and prefrontal cortices of primates performing these same tasks. It also makes predictions on how neural activity coding for the recall of the image associated with the sample emerges and becomes prospective during the training phase. The network dynamics proves to be very stable against perturbations, and it exhibits signs of scale-invariant organization and cooperativity. The present network represents a possible neural implementation for active, top-down, prospective memory retrieval in primates. The model suggests that brain activity leading to performance of cognitive tasks might be organized in modular fashion, simple neural functions becoming integrated into more complex behavior by executive structures harbored in prefrontal cortex and/or basal ganglia.     

High-throughput Computer Method for 3D Neuronal Structure Reconstruction from the Image Stack of the Drosophila Brain and Its Applications

Drosophila melanogaster is a well-studied model organism, especially in the field of neurophysiology and neural circuits. The brain of the Drosophila is small but complex, and the image of a single neuron in the brain can be acquired using confocal microscopy. Analyzing the Drosophila brain is an ideal start to understanding the neural structure. The most fundamental task in studying the neural network of Drosophila is to reconstruct neuronal structures from image stacks. Although the fruit fly brain is small, it contains approximately 100 000 neurons. It is impossible to trace all the neurons manually. This study presents a high-throughput algorithm for reconstructing the neuronal structures from 3D image stacks collected by a laser scanning confocal microscope. The proposed method reconstructs the neuronal structure by applying the shortest path graph algorithm. The vertices in the graph are certain points on the 2D skeletons of the neuron in the slices. These points are close to the 3D centerlines of the neuron branches. The accuracy of the algorithm was verified using the DIADEM data set. This method has been adopted as part of the protocol of the FlyCircuit Database, and was successfully applied to process more than 16 000 neurons. This study also shows that further analysis based on the reconstruction results can be performed to gather more information on the neural network.     

Predicting protein complex geometries with a neural network

A major challenge of the protein docking problem is to define scoring functions that can distinguish near‐native protein complex geometries from a large number of non‐native geometries (decoys) generated with noncomplexed protein structures (unbound docking). In this study, we have constructed a neural network that employs the information from atom‐pair distance distributions of a large number of decoys to predict protein complex geometries. We found that docking prediction can be significantly improved using two different types of polar hydrogen atoms. To train the neural network, 2000 near‐native decoys of even distance distribution were used for each of the 185 considered protein complexes. The neural network normalizes the information from different protein complexes using an additional protein complex identity input neuron for each complex. The parameters of the neural network were determined such that they mimic a scoring funnel in the neighborhood of the native complex structure. The neural network approach avoids the reference state problem, which occurs in deriving knowledge‐based energy functions for scoring. We show that a distance‐dependent atom pair potential performs much better than a simple atom‐pair contact potential. We have compared the performance of our scoring function with other empirical and knowledge‐based scoring functions such as ZDOCK 3.0, ZRANK, ITScore‐PP, EMPIRE, and RosettaDock. In spite of the simplicity of the method and its functional form, our neural network‐based scoring function achieves a reasonable performance in rigid‐body unbound docking of proteins. Proteins 2010. © 2009 Wiley‐Liss, Inc.     

基于神经网络的复介电常数重建算法

提出将一种神经网络的方法应用于微波断层成象,重建复的介电常数图象。微波断层成象发展了二十多年,仍然处于实验阶段,这是因为必须求解逆散射问题,它具有非适应性和非线性。为了改善其非适应性及非线性,引入适当的正则化过程并且应用神经网络的方法来求解这个问题。数值模拟实例证明了此方法的有效性。     

Memory blocking: Facts,problems, and models

The tip-of-the-tongue state, or memory blocking, is considered with regard to the feasibility of its neural network modeling. The results of psycholinguistic and neurobiological studies on memory blocking are reviewed, and basic problems that need be solved to comprehend this phenomenon are formulated. One such point is the dramatic discrepancy between the subjective assurance that an image is familiar and the inability to recollect it fully. To explain this discrepancy, we propose a biologically plausible neural network model of recognition, demonstrating cardinal superiority in the capacity of image recognition over its recollection.     

A chaotic neural network mimicking an olfactory system and its application on image recognition

1 Introduction A biological neural system is complicated and ef-ficient. People have tried for years to simulate it to per-form complex signal processing functions. For example,the artificial neural network is a kind of model derivedfrom a biological neural system. Most artificial neuralnetworks simulate some important features such as thethreshold behaviour and plasticity of synapses. However,they are primary simulations and still much simpler incomparison with specific biological neural…     

Traction force microscopy by deep learning

Cells interact mechanically with their surroundings by exerting and sensing forces. Traction force microscopy (TFM), purported to map cell-generated forces or stresses, represents an important tool that has powered the rapid advances in mechanobiology. However, to solve the ill-posed mathematical problem, conventional TFM involved compromises in accuracy and/or resolution. Here, we applied neural network-based deep learning as an alternative approach for TFM. We modified a neural network designed for image processing to predict the vector field of stress from displacements. Furthermore, we adapted a mathematical model for cell migration to generate large sets of simulated stresses and displacements for training and testing the neural network. We found that deep learning-based TFM yielded results that resemble those using conventional TFM but at a higher accuracy than several conventional implementations tested. In addition, a trained neural network is appliable to a wide range of conditions, including cell size, shape, substrate stiffness, and traction output. The performance of deep learning-based TFM makes it an appealing alternative to conventional methods for characterizing mechanical interactions between adherent cells and the environment.     

Artificial neural networks for blur identification and restoration of nonlinearly degraded images.

In this paper, an image restoration algorithm is proposed to identify noncausal blur function. Image degradation processes include both linear and nonlinear phenomena. A neural network model combining an adaptive auto-associative network with a random Gaussian process is proposed to restore the blurred image and blur function simultaneously. The noisy and blurred images are modeled as continuous associative networks, whereas auto-associative part determines the image model coefficients and the hetero-associative part determines the blur function of the system. The self-organization like structure provides the potential solution of the blind image restoration problem. The estimation and restoration are implemented by using an iterative gradient based algorithm to minimize the error function.     

Correcting distortions in panoramic images using constructive neural networks

This paper presents a novel approach to the correction of panoramic (wide-angle) image distortions. Unlike traditional methods that separate the distortion of the panoramic image into radial and tangential components and then concentrate on the correction of one type of distortion at a time, the method presented in this paper uses an integrated approach that simultaneously corrects all non-linear distortions of the panoramic image. The system uses data obtained from carefully constructed calibration patterns to automatically build and train a constructive neural network of suitable complexity to approximate the characteristic distortion of the panoramic image. The trained neural network is then used to correct the distortions represented by the sample data. It is demonstrated that by applying the distortion correction method presented in this paper to panoramic images representing real world scenes, perspective-corrected views of the real world scene that are usable in a wide variety of applications can be generated.     

Artificial intelligence in automated classification of rat vaginal smear cells.

Microscopic examination of vaginal smears has been used routinely to determine the stage of the estrous cycle of female rats in reproductive research. The stage of the estrous cycle is based on relative counts of nucleated epithelial cells, cornified epithelial cells and leukocytes. The purpose of this project was to explore automation of vaginal smear analysis using image processing and artificial intelligence techniques. A fully connected back-propagation neural network was used to locate all potential objects in a digitized scene. A unique algorithm was then employed to center a subsequent sampling box to collect pixel intensity values from the red and green components of each image. A final neural network was used in the classification of cell type. Neural networks were used because of their ability to generalize among input patterns and to tolerate extraneous noise due to variations in staining artifacts and aberrant illumination of the microscope field. This preliminary cell diagnosing system not only provides the basis for the fully automated system but also provides a method by which many other cytologic image processing problems can be automated.     

Medical Image Segmentation using PCNN based on Multi-feature Grey Wolf Optimizer Bionic Algorithm

Medical image segmentation is a challenging task especially in multimodality medical image analysis.In this paper,an improved pulse coupled neural network based...     

Recognition of handwritten similar Chinese characters by self-growing probabilistic decision-based neural network

Recognition of similar (confusion) characters is a difficult problem in optical character recognition (OCR). In this paper, we introduce a neural network solution that is capable of modeling minor differences among similar characters, and is robust to various personal handwriting styles. The Self-growing Probabilistic Decision-based Neural Network (SPDNN) is a probabilistic type neural network, which adopts a hierarchical network structure with nonlinear basis functions and a competitive credit-assignment scheme. Based on the SPDNN model, we have constructed a three-stage recognition system. First, a coarse classifier determines a character to be input to one of the pre-defined subclasses partitioned from a large character set, such as Chinese mixed with alphanumerics. Then a character recognizer determines the input image which best matches the reference character in the subclass. Lastly, the third module is a similar character recognizer, which can further enhance the recognition accuracy among similar or confusing characters. The prototype system has demonstrated a successful application of SPDNN to similar handwritten Chinese recognition for the public database CCL/HCCR1 (5401 characters x200 samples). Regarding performance, experiments on the CCL/HCCR1 database produced 90.12% recognition accuracy with no rejection, and 94.11% accuracy with 6.7% rejection, respectively. This recognition accuracy represents about 4% improvement on the previously announced performance. As to processing speed, processing before recognition (including image preprocessing, segmentation, and feature extraction) requires about one second for an A4 size character image, and recognition consumes approximately 0.27 second per character on a Pentium-100 based personal computer, without use of any hardware accelerator or co-processor.     

Oscillatory network with self-organized dynamical connections for synchronization-based image segmentation

An oscillatory network of columnar architecture located in 3D spatial lattice was recently designed by the authors as oscillatory model of the brain visual cortex. Single network oscillator is a relaxational neural oscillator with internal dynamics tunable by visual image characteristics - local brightness and elementary bar orientation. It is able to demonstrate either activity state (stable undamped oscillations) or "silence" (quickly damped oscillations). Self-organized nonlocal dynamical connections of oscillators depend on oscillator activity levels and orientations of cortical receptive fields. Network performance consists in transfer into a state of clusterized synchronization. At current stage grey-level image segmentation tasks are carried out by 2D oscillatory network, obtained as a limit version of the source model. Due to supplemented network coupling strength control the 2D reduced network provides synchronization-based image segmentation. New results on segmentation of brightness and texture images presented in the paper demonstrate accurate network performance and informative visualization of segmentation results, inherent in the model.     

Adaptation supports short-term memory in a visual change detection task

The maintenance of short-term memories is critical for survival in a dynamically changing world. Previous studies suggest that this memory can be stored in the form of persistent neural activity or using a synaptic mechanism, such as with short-term plasticity. Here, we compare the predictions of these two mechanisms to neural and behavioral measurements in a visual change detection task. Mice were trained to respond to changes in a repeated sequence of natural images while neural activity was recorded using two-photon calcium imaging. We also trained two types of artificial neural networks on the same change detection task as the mice. Following fixed pre-processing using a pretrained convolutional neural network, either a recurrent neural network (RNN) or a feedforward neural network with short-term synaptic depression (STPNet) was trained to the same level of performance as the mice. While both networks are able to learn the task, the STPNet model contains units whose activity are more similar to the in vivo data and produces errors which are more similar to the mice. When images are omitted, an unexpected perturbation which was absent during training, mice often do not respond to the omission but are more likely to respond to the subsequent image. Unlike the RNN model, STPNet produces a similar pattern of behavior. These results suggest that simple neural adaptation mechanisms may serve as an important bottom-up memory signal in this task, which can be used by downstream areas in the decision-making process.     

基于人工神经网络的生态环境质量遥感评价

利用ETM遥感数据提取反映生态环境的植被、土壤亮度、湿度,MODIS地表温度产品提取的热度指数、气象指数及其它地学辅助信息作为神经网络的输入,野外调查标准兴趣区的遥感本底值评分值作为网络输出,建立一个3层结构的BP神经网络生态环境遥感本底值预测模型.利用MATLAB软件对网络进行训练和研究区生态环境遥感本底值的预测输出,并将预测结果按照生态环境遥感本底值分级评分标准进行等级划分.结果表明,总体分类精度达87.8%.利用神经网络方法对生态环境遥感本底值进行预测是可行的.采用先预测再分级的方法不仅能很好地评价区域生态环境质量,而且能够和区域生态环境类型紧密的结合起来.     

Physical models of neural networks

The state of art in computer modelling of neural networks with associative memory is reviewed. The available experimental data are considered on learning and memory of small neural systems, on isolated synapses and on molecular level. Computer simulations demonstrate that realistic models of neural ensembles exhibit properties which can be interpreted as image recognition, categorization, learning, prototype forming, etc. A bilayer model of associative neural network is proposed. One layer corresponds to the short-term memory, the other one to the long-term memory. Patterns are stored in terms of the synaptic strength matrix. We have studied the relaxational dynamics of neurons firing and suppression within the short-term memory layer under the influence of the long-term memory layer. The interaction among the layers has found to create a number of novel stable states which are not the learning patterns. These synthetic patterns may consist of elements belonging to different non-intersecting learning patterns. Within the framework of a hypothesis of selective and definite coding of images in brain one can interpret the observed effect as the "idea? generating" process.