A Switching Controller System for a Wheeled Mobile Robot

A wheeled mobile mechanism with a passive and/or active linkage mechanism for rough terrain environment is developed and evaluated. The wheeled mobile mechanism which has high mobility in rough terrain needs sophisticated system to adapt various environments.We focus on the development of a switching controller system for wheeled mobile robots in rough terrain. This system consists of two sub-systems: an environment recognition system using link angles and an adaptive control system. In the environment recognition system, we introduce a Self-Organizing Map (SOM) for clustering link angles. In the adaptive controllers, we introduce neural networks to calculate the inverse model of the wheeled mobile robot.The environment recognition system can recognize the environment in which the robot travels, and the adjustable controllers are tuned by experimental results for each environment. The dual sub-system switching controller system is experimentally evaluated. The system recognizes its environment and adapts by switching the adjustable controllers. This system demonstrates superior performance to a well-tuned single PID controller.     

Path formation in a robot swarm

We present two swarm intelligence control mechanisms used for distributed robot path formation. In the first, the robots form linear chains. We study three variants of robot chains, which vary in the degree of motion allowed to the chain structure. The second mechanism is called vectorfield. In this case, the robots form a pattern that globally indicates the direction towards a goal or home location. We test each controller on a task that consists in forming a path between two objects which an individual robot cannot perceive simultaneously. Our simulation experiments show promising results. All the controllers are able to form paths in complex obstacle environments and exhibit very good scalability, robustness, and fault tolerance characteristics. Additionally, we observe that chains perform better for small robot group sizes, while vectorfield performs better for large groups.     

Robot control and the evolution of modular neurodynamics

Summary A modular approach to neural behavior control of autonomous robots is presented. It is based on the assumption that complex internal dynamics of recurrent neural networks can efficiently solve complex behavior tasks. For the development of appropriate neural control structures an evolutionary algorithm is introduced, which is able to generate neuromodules with specific functional properties, as well as the connectivity structure for a modular synthesis of such modules. This so called ENS ³-algorithm does not use genetic coding. It is primarily designed to develop size and connectivity structure of neuro-controllers. But at the same time it optimizes also parameters of individual networks like synaptic weights and bias terms. For demonstration, evolved networks for the control of miniature Khepera robots are presented. The aim is to develop robust controllers in the sense that neuro-controllers evolved in a simulator show comparably good behavior when loaded to a real robot acting in a physical environment. Discussed examples of such controllers generate obstacle avoidance and phototropic behaviors in non-trivial environments.     

Environment Recognition System Based on Multiple Classification Analyses for Mobile Robots

Various mechanisms have recently been developed that combine linkage mechanisms and wheels. In particular, the combination of passive linkage mechanisms and small wheels is a main research trend because standard wheeled mobile mechanisms find it difficult to move on rough terrain. In our previous research, a six-wheel mobile robot employing a passive linkage mechanism has been developed to enhance maneuverability and was able to climb over a 0.20 m bump and stairs. We designed a hybrid velocity and torque controller using a neural network since simple velocity controllers fail to climb up. In this paper, we propose an environment recognition system for a wheeled mobile robot that consists of multiple classification analyses to make the robot more adaptive to various environments by selecting a suitable system such as decision making, navigation and controller using the result of the environment recognition system. We evaluate the recognition performance in operation environments; slopes, bumps and stairs by comparing principle component, k-means and self-organizing map analyses.     

Information flow principles for plasticity in foraging robot swarms

An important characteristic of a robot swarm that must operate in the real world is the ability to cope with changeable environments by exhibiting behavioural plasticity at the collective level. For example, a swarm of foraging robots should be able to repeatedly reorganise in order to exploit resource deposits that appear intermittently in different locations throughout their environment. In this paper, we report on simulation experiments with homogeneous foraging robot teams and show that analysing swarm behaviour in terms of information flow can help us to identify whether a particular behavioural strategy is likely to exhibit useful swarm plasticity in response to dynamic environments. While it is beneficial to maximise the rate at which robots share information when they make collective decisions in a static environment, plastic swarm behaviour in changeable environments requires regulated information transfer in order to achieve a balance between the exploitation of existing information and exploration leading to acquisition of new information. We give examples of how information flow analysis can help designers to decide on robot control strategies with relevance to a number of applications explored in the swarm robotics literature.     

Deriving neural network controllers from neuro-biological data: implementation of a single-leg stick insect controller

This article presents modular recurrent neural network controllers for single legs of a biomimetic six-legged robot equipped with standard DC motors. Following arguments of Ekeberg et?al. (Arthropod Struct Dev 33:287?C300, 2004), completely decentralized and sensori-driven neuro-controllers were derived from neuro-biological data of stick-insects. Parameters of the controllers were either hand-tuned or optimized by an evolutionary algorithm. Employing identical controller structures, qualitatively similar behaviors were achieved for robot and for stick insect simulations. For a wide range of perturbing conditions, as for instance changing ground height or up- and downhill walking, swing as well as stance control were shown to be robust. Behavioral adaptations, like varying locomotion speeds, could be achieved by changes in neural parameters as well as by a mechanical coupling to the environment. To a large extent the simulated walking behavior matched biological data. For example, this was the case for body support force profiles and swing trajectories under varying ground heights. The results suggest that the single-leg controllers are suitable as modules for hexapod controllers, and they might therefore bridge morphological- and behavioral-based approaches to stick insect locomotion control.     

Design of hierarchical coordination model for ubiquitous application

Our research targets collaborative environments with focus on mobility and teams. This environment comprise a number of people working on multiple tasks and activities simultaneously. As mobile and wireless technology advances people are no longer bound to their offices. Team members are able to collaborate while on the move. So, mobile ubiquitous application can be a best solution to provide a mobility and collaboration for the environment. And the issue must be considered how to coordinate these ubiquitous application seamlessly and efficiently.     

Simultaneous Optimization of Robot Structure and Control System Using Evolutionary Algorithm

The simultaneous optimization of a robot structure and control system to realize effective mobility in an outdoor environment is investigated. Recently, various wheeled mechanisms with passive and/or active linkages for outdoor environments have been developed and evaluated. We developed a mobile robot having six active wheels and passive linkage mechanisms, and experimentally verified its maneuverability in an indoor environment. However, there are various obstacles in outdoor environment and the travel ability of a robot thus depends on its mechanical structure and control system.We proposed a method of simultaneously optimizing mobile robot structure and control system using an evolutionary algorithm. Here, a gene expresses the parameters of the structure and control system. A simulated mobile robot and controller are based on these parameters and the behavior of the mobile robot is evaluated for three typical obstacles. From the evaluation results, new genes are created and evaluated repeatedly. The evaluation items are travel distance, travel time, energy consumption, control accuracy, and attitude of the robot.Effective outdoor travel is achieved around the 80th generation, after which, other parameters are optimized until the 300th generation. The optimized gene is able to pass through the three obstacles with low energy consumption, accurate control, and stable attitude.     

Software extensions to UCSF chimera for interactive visualization of large molecular assemblies

Many structures of large molecular assemblies such as virus capsids and ribosomes have been experimentally determined to atomic resolution. We consider four software problems that arise in interactive visualization and analysis of large assemblies: how to represent multimers efficiently, how to make cartoon representations, how to calculate contacts efficiently, and how to select subassemblies. We describe techniques and algorithms we have developed and give examples of their use. Existing molecular visualization programs work well for single protein and nucleic acid molecules and for small complexes. The methods presented here are proposed as features to add to existing programs or include in next-generation visualization software to allow easy exploration of assemblies containing tens to thousands of macromolecules. Our approach is pragmatic, emphasizing simplicity of code, reliability, and speed. The methods described have been distributed as the Multiscale extension of the UCSF Chimera (www.cgl.ucsf.edu/chimera) molecular graphics program.     

Selection of microbial mutants tolerant to extreme environmental stress using continuous culture-control design

The design of controllers for a continuous selection technique (BOICS; Brown and Oliver, 1982) is considered. This technique is used to obtain microbial mutants that are tolerant to extreme environmental stress. Applications of BOICS have been hampered by the problem of controller design. In this paper, a modified implementation of BOICS is considered which has a number of practical advantages. A model-based approach to controller design is taken. The case in which the stress is due to an inhibitory substance in the growth environment is considered. The analysis is intended to be applicable to any reasonable combination of organism and inhibitor. Conventional linear and time-invariant controllers are considered. Guidelines for the selection of controller parameters' values are suggested. The application of these guidelines requires that certain process parameters' values be identified. Methods by which these parameters' values can be identified are suggested. Simulation results indicate that the resulting controllers perform satisfactorily. This is confirmed by experimental data from a model selection experiment. A recipe for the design of controllers is a necessary part of a protocol for BOICS. It is hoped that the solution to the controller design problem that is offered in this paper will encourage further applications for the technique.     

Evolution of Collective Behaviors for a Real Swarm of Aquatic Surface Robots

Swarm robotics is a promising approach for the coordination of large numbers of robots. While previous studies have shown that evolutionary robotics techniques can be applied to obtain robust and efficient self-organized behaviors for robot swarms, most studies have been conducted in simulation, and the few that have been conducted on real robots have been confined to laboratory environments. In this paper, we demonstrate for the first time a swarm robotics system with evolved control successfully operating in a real and uncontrolled environment. We evolve neural network-based controllers in simulation for canonical swarm robotics tasks, namely homing, dispersion, clustering, and monitoring. We then assess the performance of the controllers on a real swarm of up to ten aquatic surface robots. Our results show that the evolved controllers transfer successfully to real robots and achieve a performance similar to the performance obtained in simulation. We validate that the evolved controllers display key properties of swarm intelligence-based control, namely scalability, flexibility, and robustness on the real swarm. We conclude with a proof-of-concept experiment in which the swarm performs a complete environmental monitoring task by combining multiple evolved controllers.     

Distributed scalable multi-robot learning using particle swarm optimization

Designing effective behavioral controllers for mobile robots can be difficult and tedious; this process can be circumvented by using online learning techniques which allow robots to generate their own controllers online in an automated fashion. In multi-robot systems, robots operating in parallel can potentially learn at a much faster rate by sharing information amongst themselves. In this work, we use an adapted version of the Particle Swarm Optimization algorithm in order to accomplish distributed online robotic learning in groups of robots with access to only local information. The effectiveness of the learning technique on a benchmark task (generating high-performance obstacle avoidance behavior) is evaluated for robot groups of various sizes, with the maximum group size allowing each robot to individually contain and manage a single PSO particle. To increase the realism of the technique, different PSO neighborhoods based on limitations of real robotic communication are tested and compared in this scenario. We explore the effect of varying communication power for one of these communication-based PSO neighborhoods. To validate the effectiveness of these learning techniques, fully distributed online learning experiments are run using a group of 10 real robots, generating results which support the findings from our simulations.     

The study of neural network-based controller for controlling dissolved oxygen concentration in a sequencing batch reactor

The design and development of the neural network (NN)-based controller performance for the activated sludge process in sequencing batch reactor (SBR) is presented in this paper. Here we give a comparative study of various neural network (NN)-based controllers such as the direct inverse control, internal model control (IMC) and hybrid NN control strategies to maintain the dissolved oxygen (DO) level of an activated sludge system by manipulating the air flow rate. The NN inverse model-based controller with the model-based scheme represents the controller, which relies solely upon the simple NN inverse model. In the IMC, both the forward and inverse models are used directly as elements within the feedback loop. The hybrid NN control consists of a basic NN controller in parallel with a proportional integral (PI) controller. Various simulation tests involving multiple set-point changes, disturbances rejection and noise effects were performed to review the performances of these various controllers. From the results it can be seen that hybrid controller gives the best results in tracking set-point changes under disturbances and noise effects.     

Predicting adaptive behavior in the environment from central nervous system dynamics

To generate adaptive behavior, the nervous system is coupled to the environment. The coupling constrains the dynamical properties that the nervous system and the environment must have relative to each other if adaptive behavior is to be produced. In previous computational studies, such constraints have been used to evolve controllers or artificial agents to perform a behavioral task in a given environment. Often, however, we already know the controller, the real nervous system, and its dynamics. Here we propose that the constraints can also be used to solve the inverse problem--to predict from the dynamics of the nervous system the environment to which they are adapted, and so reconstruct the production of the adaptive behavior by the entire coupled system. We illustrate how this can be done in the feeding system of the sea slug Aplysia. At the core of this system is a central pattern generator (CPG) that, with dynamics on both fast and slow time scales, integrates incoming sensory stimuli to produce ingestive and egestive motor programs. We run models embodying these CPG dynamics--in effect, autonomous Aplysia agents--in various feeding environments and analyze the performance of the entire system in a realistic feeding task. We find that the dynamics of the system are tuned for optimal performance in a narrow range of environments that correspond well to those that Aplysia encounter in the wild. In these environments, the slow CPG dynamics implement efficient ingestion of edible seaweed strips with minimal sensory information about them. The fast dynamics then implement a switch to a different behavioral mode in which the system ignores the sensory information completely and follows an internal "goal," emergent from the dynamics, to egest again a strip that proves to be inedible. Key predictions of this reconstruction are confirmed in real feeding animals.     

Quantitative cell biology with the Virtual Cell

Cell biological processes are controlled by an interacting set of biochemical and electrophysiological events that are distributed within complex cellular structures. Computational models, comprising quantitative data on the interacting molecular participants in these events, provide a means for applying the scientific method to these complex systems. The Virtual Cell is a computational environment designed for cell biologists, to facilitate the construction of models and the generation of predictive simulations from them. This review summarizes how a Virtual Cell model is assembled and describes the physical principles underlying the calculations that are performed. Applications to problems in nucleocytoplasmic transport and intracellular calcium dynamics will illustrate the power of this paradigm for elucidating cell biology.     

Full-state tracking control of a mobile robot using neural networks

In this paper a nonholonomic mobile robot with completely unknown dynamics is discussed. A mathematical model has been considered and an efficient neural network is developed, which ensures guaranteed tracking performance leading to stability of the system. The neural network assumes a single layer structure, by taking advantage of the robot regressor dynamics that expresses the highly nonlinear robot dynamics in a linear form in terms of the known and unknown robot dynamic parameters. No assumptions relating to the boundedness is placed on the unmodeled disturbances. It is capable of generating real-time smooth and continuous velocity control signals that drive the mobile robot to follow the desired trajectories. The proposed approach resolves speed jump problem existing in some previous tracking controllers. Further, this neural network does not require offline training procedures. Lyapunov theory has been used to prove system stability. The practicality and effectiveness of the proposed tracking controller are demonstrated by simulation and comparison results.     

The design of controllers for batch bioreactors

The implementation of control algorithms to batch bioreactors is often complicated by variations in process dynamics that occur during the course of fermentation. Such a wide operating range often renders the performance of fixed gain proportional-integral-differential (PID) controllers unsatisfactory. In this work, detailed studies on the control of batch fermentations are per formed. Two simple controller designs are presented with the intent to compensate for changing process dynamics. One design incorporates the concepts of static feedforward-feedback control. While this technique produces tighter control than feedback alone, it is not as successful as a controller based on gain scheduling. The gain-scheduling controller, a subclass of adaptive controllers, uses the oxygen uptake rate as an auxiliary variable to fine-tune the PID controller parameters. The control of oxygen tension in the bioreactor is used as a vehicle to convey the proposed ideas, analyses, and results. Simulation experiments indicate significant improvement in controller performance can be achieved by both of the proposed approaches even in the presence of measurement noise.     

A brain-inspired compact cognitive mapping system

In many simultaneous localization and mapping (SLAM) systems, the map of the environment grows over time as the robot explores the environment. The ever-growing map prevents long-term mapping, especially in large-scale environments. In this paper, we develop a compact cognitive mapping approach inspired by neurobiological experiments. Mimicking the firing activities of neighborhood cells, neighborhood fields determined by movement information, i.e. translation and rotation, are modeled to describe one of the distinct segments of the explored environment. The vertices with low neighborhood field activities are avoided to be added into the cognitive map. The optimization of the cognitive map is formulated as a robust non-linear least squares problem constrained by the transitions between vertices, and is numerically solved efficiently. According to the cognitive decision-making of place familiarity, loop closure edges are clustered depending on time intervals, and then batch global optimization of the cognitive map is performed to satisfy the combined constraint of the whole cluster. After the loop closure process, scene integration is performed, in which revisited vertices are removed subsequently to further reduce the size of the cognitive map. The compact cognitive mapping approach is tested on a monocular visual SLAM system in a naturalistic maze for a biomimetic animated robot. Our results demonstrate that the proposed method largely restricts the growth of the size of the cognitive map over time, and meanwhile, the compact cognitive map correctly represents the overall layout of the environment. The compact cognitive mapping method is well suitable for the representation of large-scale environments to achieve long-term robot navigation. Electronic supplementary materialThe online version of this article (10.1007/s11571-020-09621-6) contains supplementary material, which is available to authorized users.     

A Controller Design Method Based on a Neural Network for an Outdoor Mobile Robot

A wheeled mobile mechanism with a passive and/or active linkage mechanism for travel in rough terrain is developed and evaluated. In our previous research, we developed a switching controller system for wheeled mobile robots in rough terrain. This system consists of two sub-systems: an environment recognition system using a self-organizing map and an adjusted control system using a neural network. In this paper, we propose a new controller design method based on a neural network. The proposed method involves three kinds of controllers: an elementary controller, adjusted controllers, and simplified controllers. In the experiments, our proposed method results in less oscillatory motion in rough terrain and performs better than a well tuned PID controller does.