A Comprehensive Review of Swarm Optimization Algorithms

Many swarm optimization algorithms have been introduced since the early 60’s, Evolutionary Programming to the most recent, Grey Wolf Optimization. All of these algorithms have demonstrated their potential to solve many optimization problems. This paper provides an in-depth survey of well-known optimization algorithms. Selected algorithms are briefly explained and compared with each other comprehensively through experiments conducted using thirty well-known benchmark functions. Their advantages and disadvantages are also discussed. A number of statistical tests are then carried out to determine the significant performances. The results indicate the overall advantage of Differential Evolution (DE) and is closely followed by Particle Swarm Optimization (PSO), compared with other considered approaches.     

Task scheduling on computational Grids using Gravitational Search Algorithm

Grid computing uses distributed interconnected computers and resources collectively to achieve higher performance computing and resource sharing. Task scheduling is one of the core steps to efficiently exploit the capabilities of Grid environment. Recently, heuristic algorithms have been successfully applied to solve task scheduling on computational Grids. In this paper, Gravitational Search Algorithm (GSA), as one of the latest population-based metaheuristic algorithms, is used for task scheduling on computational Grids. The proposed method employs GSA to find the best solution with the minimum makespan and flowtime. We evaluate this approach with Genetic Algorithm (GA) and Particle Swarm Optimization (PSO) method. The results demonstrate that the benefit of the GSA is its speed of convergence and the capability to obtain feasible schedules.     

Optimized Particle Swarm Optimization (OPSO) and its application to artificial neural network training

Background  

Particle Swarm Optimization (PSO) is an established method for parameter optimization. It represents a population-based adaptive optimization technique that is influenced by several "strategy parameters". Choosing reasonable parameter values for the PSO is crucial for its convergence behavior, and depends on the optimization task. We present a method for parameter meta-optimization based on PSO and its application to neural network training. The concept of the Optimized Particle Swarm Optimization (OPSO) is to optimize the free parameters of the PSO by having swarms within a swarm. We assessed the performance of the OPSO method on a set of five artificial fitness functions and compared it to the performance of two popular PSO implementations.     

A cooperative particle swarm optimizer with migration of heterogeneous probabilistic models

Particle Swarm Optimization (PSO) is a stochastic optimization approach that originated from simulations of bird flocking, and that has been successfully used in many applications as an optimization tool. Estimation of distribution algorithms (EDAs) are a class of evolutionary algorithms which perform a two-step process: building a probabilistic model from which good solutions may be generated and then using this model to generate new individuals. Two distinct research trends that emerged in the past few years are the hybridization of PSO and EDA algorithms and the parallelization of EDAs to exploit the idea of exchanging the probabilistic model information. In this work, we propose the use of a cooperative PSO/EDA algorithm based on the exchange of heterogeneous probabilistic models. The model is heterogeneous because the cooperating PSO/EDA algorithms use different methods to sample the search space. Three different exchange approaches are tested and compared in this work. In all these approaches, the amount of information exchanged is adapted based on the performance of the two cooperating swarms. The performance of the cooperative model is compared to the existing state-of-the-art PSO cooperative approaches using a suite of well-known benchmark optimization functions.     

Markerless Human Motion Tracking Using Hierarchical Multi-Swarm Cooperative Particle Swarm Optimization

The high-dimensional search space involved in markerless full-body articulated human motion tracking from multiple-views video sequences has led to a number of solutions based on metaheuristics, the most recent form of which is Particle Swarm Optimization (PSO). However, the classical PSO suffers from premature convergence and it is trapped easily into local optima, significantly affecting the tracking accuracy. To overcome these drawbacks, we have developed a method for the problem based on Hierarchical Multi-Swarm Cooperative Particle Swarm Optimization (H-MCPSO). The tracking problem is formulated as a non-linear 34-dimensional function optimization problem where the fitness function quantifies the difference between the observed image and a projection of the model configuration. Both the silhouette and edge likelihoods are used in the fitness function. Experiments using Brown and HumanEva-II dataset demonstrated that H-MCPSO performance is better than two leading alternative approaches—Annealed Particle Filter (APF) and Hierarchical Particle Swarm Optimization (HPSO). Further, the proposed tracking method is capable of automatic initialization and self-recovery from temporary tracking failures. Comprehensive experimental results are presented to support the claims.     

A novel task scheduling approach based on dynamic queues and hybrid meta-heuristic algorithms for cloud computing environment

Task scheduling is one of the most challenging aspects to improve the overall performance of cloud computing and optimize cloud utilization and Quality of Service (QoS). This paper focuses on Task Scheduling optimization using a novel approach based on Dynamic dispatch Queues (TSDQ) and hybrid meta-heuristic algorithms. We propose two hybrid meta-heuristic algorithms, the first one using Fuzzy Logic with Particle Swarm Optimization algorithm (TSDQ-FLPSO), the second one using Simulated Annealing with Particle Swarm Optimization algorithm (TSDQ-SAPSO). Several experiments have been carried out based on an open source simulator (CloudSim) using synthetic and real data sets from real systems. The experimental results demonstrate the effectiveness of the proposed approach and the optimal results is provided using TSDQ-FLPSO compared to TSDQ-SAPSO and other existing scheduling algorithms especially in a high dimensional problem. The TSDQ-FLPSO algorithm shows a great advantage in terms of waiting time, queue length, makespan, cost, resource utilization, degree of imbalance, and load balancing.     

Optimal Formation Reconfiguration Control of Multiple UCAVs Using Improved Particle Swarm Optimization

Optimal formation reconfiguration control of multiple Uninhabited Combat Air Vehicles （UCAVs） is a complicated global optimum problem. Particle Swarm Optimization （PSO） is a population based stochastic optimization technique inspired by social behaviour of bird flocking or fish schooling. PSO can achieve better results in a faster, cheaper way compared with other bio-inspired computational methods, and there are few parameters to adjust in PSO. In this paper, we propose an improved PSO model for solving the optimal formation reconfiguration control problem for multiple UCAVs. Firstly, the Control Parameterization and Time Diseretization （CPTD） method is designed in detail. Then, the mutation strategy and a special mutation-escape operator are adopted in the improved PSO model to make particles explore the search space more efficiently. The proposed strategy can produce a large speed value dynamically according to the variation of the speed, which makes the algorithm explore the local and global minima thoroughly at the same time. Series experimental results demonstrate the feasibility and effectiveness of the proposed method in solving the optimal formation reconfiguration control problem for multiple UCAVs.     

V - Channel magnification enabled by hybrid optimization algorithm: Enhancement of video super resolution

Although being a really active area of research, television super-resolution remains a difficult problem. Additionally, it is noted that the blur motion and computational crisis hinder the enhancement. As a result, the goal of this research is to present a brand-new smart SR framework for the camera shot. To create High Resolution (HR) videos, first frames in RGB format are converted to HSV and then the V-channel is enhanced. In order to create enriched video frames, a high - dimension grid with enhanced pixel intensity is then created. This paper introduces a particular progression to enable this: Motion estimation, Cubic Spline Interpolation, and Deblurring or Sharpening are the three methods. By carefully adjusting the parameters, the cubic spline interpolation is improved during operation. A brand-new hybrid technique dubbed Lion with Particle Swarm Velocity Update (LPSO-VU), which combines the principles of the Lion Algorithm (LA) and Particle Swarm Optimization (PSO) algorithms, is presented for this optimal tuning purpose. Finally, using the BRISQUE, SDME, and ESSIM metrics, the adequacy of the method is contrasted to other traditional models, and its superiority is demonstrated. Accordingly, the analysis shows that the suggested LPSO-VU model for video frame 1 is 16.6%, 25.56%, 26.2%, 26.2%, and 27.2% superior to the previous systems like PSO, GWO, WOA, ROA, MF-ROA, and LA, respectively, in terms of BRISQUE.     

Performance evaluation of TRIBES, an adaptive particle swarm optimization algorithm

This paper presents a study of the performance of TRIBES, an adaptive particle swarm optimization algorithm. Particle Swarm Optimization (PSO) is a biologically-inspired optimization method. Recently, researchers have used it effectively in solving various optimization problems. However, like most optimization heuristics, PSO suffers from the drawback of being greatly influenced by the selection of its parameter values. Thus, the common belief is that the performance of a PSO algorithm is directly related to the tuning of such parameters. Usually, such tuning is a lengthy, time consuming and delicate process. A new adaptive PSO algorithm called TRIBES avoids manual tuning by defining adaptation rules which aim at automatically changing the particles’ behaviors as well as the topology of the swarm. In TRIBES, the topology is changed according to the swarm behavior and the strategies of displacement are chosen according to the performances of the particles. A comparative study carried out on a large set of benchmark functions shows that the performance of TRIBES is quite competitive compared to most other similar PSO algorithms that need manual tuning of parameters. The performance evaluation of TRIBES follows the testing procedure introduced during the 2005 IEEE Conference on Evolutionary Computation. The main objective of the present paper is to perform a global study of the behavior of TRIBES under several conditions, in order to determine strengths and drawbacks of this adaptive algorithm.     

Benchmarking the Clustering Performances of Evolutionary Algorithms: A Case Study on Varying Data Size

Background and objectiveClustering is a widely used popular method for data analysis within many clustering algorithms for years. Today it is used in many predictions, collaborative filtering and automatic segmentation systems on different domains. Also, to be broadly used in practice, such clustering algorithms need to give both better performance and robustness when compared to the ones currently used. In recent years, evolutionary algorithms are used in many domains since they are robust and easy to implement. And many clustering problems can be easily solved with such algorithms if the problem is modeled as an optimization problem. In this paper, we present an optimization approach for clustering by using four well-known evolutionary algorithms which are Biogeography-Based Optimization (BBO), Grey Wolf Optimization (GWO), Genetic Algorithm (GA) and Particle Swarm Optimization (PSO).Methodthe objective function has been specified to minimize the total distance from cluster centers to the data points. Euclidean distance is used for distance calculation. We have applied this objective function to the given algorithms both to find the most efficient clustering algorithm and to compare the clustering performances of algorithms against different data sizes. In order to benchmark the clustering performances of algorithms in the experiments, we have used a number of datasets with different data sizes such as some small scale, medium and big data. The clustering performances have been compared to K-means as it is a widely used clustering algorithm for years in literature. Rand Index, Adjusted Rand Index, Mirkin's Index and Hubert's Index have been considered as parameters for evaluating the clustering performances.ResultAs a result of the clustering experiments of algorithms over different datasets with varying data sizes according to the specified performance criteria, GA and GWO algorithms show better clustering performances among the others.ConclusionsThe results of the study showed that although the algorithms have shown satisfactory clustering results on small and medium scale datasets, the clustering performances on Big data need to be improved.     

Hierarchical winner-take-all particle swarm optimization social network for neural model fitting

Particle swarm optimization (PSO) has gained widespread use as a general mathematical programming paradigm and seen use in a wide variety of optimization and machine learning problems. In this work, we introduce a new variant on the PSO social network and apply this method to the inverse problem of input parameter selection from recorded auditory neuron tuning curves. The topology of a PSO social network is a major contributor to optimization success. Here we propose a new social network which draws influence from winner-take-all coding found in visual cortical neurons. We show that the winner-take-all network performs exceptionally well on optimization problems with greater than 5 dimensions and runs at a lower iteration count as compared to other PSO topologies. Finally we show that this variant of PSO is able to recreate auditory frequency tuning curves and modulation transfer functions, making it a potentially useful tool for computational neuroscience models.     

基于粒子群优化算法的脑磁图源定位

脑磁图作为一种新型的脑探测技术,具有较高定位精度和毫秒级时间分辨率的特点。快速准确地利用脑磁图技术对三维空间中的脑神经活动源进行定位,对于脑功能研究和医学临床应用都具有重要的应用价值。可是,目前的脑磁图源定位广泛采用了多信号分类方法,它要求对三维大脑空间进行全局扫描,需要大量的计算,存在速度慢的缺点。针对这一问题,提出了一种基于粒子群优化算法的脑磁图源定位方法。先利用粒子群优化算法全局搜索能力强的特点寻找出目标函数的全局最优值,进行初步的脑磁图源定位;然后,再在小范围内进行小网格的搜索,进一步实现精确的定位。实验结果表明,基于粒子群优化算法的脑磁图源定位能够很好地解决上述问题,具有计算速度快、定位精度高的特点。     

Evaluation of a particle swarm algorithm for biomechanical optimization

Optimization is frequently employed in biomechanics research to solve system identification problems, predict human movement, or estimate muscle or other internal forces that cannot be measured directly. Unfortunately, biomechanical optimization problems often possess multiple local minima, making it difficult to find the best solution. Furthermore, convergence in gradient-based algorithms can be affected by scaling to account for design variables with different length scales or units. In this study we evaluate a recently-developed version of the particle swarm optimization (PSO) algorithm to address these problems. The algorithm's global search capabilities were investigated using a suite of difficult analytical test problems, while its scale-independent nature was proven mathematically and verified using a biomechanical test problem. For comparison, all test problems were also solved with three off-the-shelf optimization algorithms--a global genetic algorithm (GA) and multistart gradient-based sequential quadratic programming (SQP) and quasi-Newton (BFGS) algorithms. For the analytical test problems, only the PSO algorithm was successful on the majority of the problems. When compared to previously published results for the same problems, PSO was more robust than a global simulated annealing algorithm but less robust than a different, more complex genetic algorithm. For the biomechanical test problem, only the PSO algorithm was insensitive to design variable scaling, with the GA algorithm being mildly sensitive and the SQP and BFGS algorithms being highly sensitive. The proposed PSO algorithm provides a new off-the-shelf global optimization option for difficult biomechanical problems, especially those utilizing design variables with different length scales or units.     

A competitive clustering particle swarm optimizer for dynamic optimization problems

Optimization in dynamic optimization problems (DOPs) requires the optimization algorithms not only to locate, but also to continuously track the moving optima. Particle swarm optimization (PSO) is a population-based optimization algorithm, originally developed for static problems. Recently, several researchers have proposed variants of PSO for optimization in DOPs. This paper presents a novel multi-swarm PSO algorithm, namely competitive clustering PSO (CCPSO), designed specially for DOPs. Employing a multi-stage clustering procedure, CCPSO splits the particles of the main swarm over a number of sub-swarms based on the particles positions and on their objective function values. The algorithm automatically adjusts the number of sub-swarms and the corresponding region of each sub-swarm. In addition to the sub-swarms, there is also a group of free particles that explore the environment to locate new emerging optima or exploit the current optima which are not followed by any sub-swarm. The adaptive search strategy adopted by the sub-swarms improves both the exploitation and tracking characteristics of CCPSO. A set of experiments is conducted to study the behavior of the proposed algorithm in different DOPs and to provide guidelines for setting the algorithm’s parameters in different problems. The results of CCPSO on a variety of moving peaks benchmark (MPB) functions are compared with those of several state-of-the-art PSO algorithms, indicating the efficiency of the proposed model.     

Automatic VMAT planning for post-operative prostate cancer cases using particle swarm optimization: A proof of concept study

ObjectiveTo investigate the potential of Particle Swarm Optimization (PSO) for fully automatic VMAT radiotherapy (RT) treatment planning.Material and MethodsIn PSO a solution space of planning constraints is searched for the best possible RT plan in an iterative, statistical method, optimizing a population of candidate solutions. To identify the best candidate solution and for final evaluation a plan quality score (PQS), based on dose volume histogram (DVH) parameters, was introduced.Automatic PSO-based RT planning was used for N = 10 postoperative prostate cancer cases, retrospectively taken from our clinical database, with a prescribed dose of EUD = 66 Gy in addition to two constraints for rectum and one for bladder. Resulting PSO-based plans were compared dosimetrically to manually generated VMAT plans.ResultsPSO successfully proposed treatment plans comparable to manually optimized ones in 9/10 cases. The median (range) PTV EUD was 65.4 Gy (64.7–66.0) for manual and 65.3 Gy (62.5–65.5) for PSO plans, respectively. However PSO plans achieved significantly lower doses in rectum D_2% 67.0 Gy (66.5–67.5) vs. 66.1 Gy (64.7–66.5, p = 0.016). All other evaluated parameters (PTV D_98% and D_2%, rectum V_40Gy and V_60Gy, bladder D_2% and V_60Gy) were comparable in both plans. Manual plans had lower PQS compared to PSO plans with −0.82 (−16.43–1.08) vs. 0.91 (−5.98–6.25).ConclusionPSO allows for fully automatic generation of VMAT plans with plan quality comparable to manually optimized plans. However, before clinical implementation further research is needed concerning further adaptation of PSO-specific parameters and the refinement of the PQS.     

基于PSO-LSSVR模型的土壤肥力评价

通过引入粒子群算法(PSO)和最小二乘支持向量机(LSSVR),提出基于PSO-LSSVR的土壤肥力评价模型。选取有机质、全氮速效磷、速效钾、阳离子交换量、酸碱度、容重、黏粒、水稳性团聚体和分散率等10种评价指标,以吉林省黑地为例,建立土壤肥力评价模型。同时与物元可拓法、普通SVM模型的评价结果进行比较;3种方法的多数样本评价结果基本一致,对于样本2、样本13,PSO-LSSVR模型分别定为Ⅳ级、Ⅲ级,符合实际情况;表明PSO-LSSVR是一种适用且能准确反映土壤特性的土壤肥力评价模型。     

Research on Location Characteristics and Algorithms based on Frequency Domain for a 2D Underwater Active Electrolocation Positioning System

Weakly electric fish has an ability to generate a low-frequency electric field actively to locate the surrounding object in complete darkness by sensing the change of the electric field.This ability is called active electrolocation.In this paper,we designed a two-dimensional (2D) experimental platform of underwater active electrolocation system by simulating weakly electric fish.On the platform,location characteristics based on frequency domain were investigated.Results indicated that surface shape of 3D location characteristic curves for the 2D underwater active electrolocation positioning system was convex upwards or concave down which was influenced by the material of probed objects and the frequency of the electric field excitation signal.Experiments also confirmed that the amplitude of the electric field excitation signal and the size of the probed object will only influence the amplitude corresponding to 3D location characteristic curves.Based on above location characteristics,we present three location algorithms including Cross Location Algorithm (CLA),Stochastic Location Algorithm (SLA) and Particle Swarm Optimization (PSO) location algorithm in frequency domain and achieved the task of the underwater positioning system.Our work may have reference value for underwater detection study.     

ICGA-PSO-ELM approach for accurate multiclass cancer classification resulting in reduced gene sets in which genes encoding secreted proteins are highly represented

A combination of Integer-Coded Genetic Algorithm (ICGA) and Particle Swarm Optimization (PSO), coupled with the neural-network-based Extreme Learning Machine (ELM), is used for gene selection and cancer classification. ICGA is used with PSO-ELM to select an optimal set of genes, which is then used to build a classifier to develop an algorithm (ICGA_PSO_ELM) that can handle sparse data and sample imbalance. We evaluate the performance of ICGA-PSO-ELM and compare our results with existing methods in the literature. An investigation into the functions of the selected genes, using a systems biology approach, revealed that many of the identified genes are involved in cell signaling and proliferation. An analysis of these gene sets shows a larger representation of genes that encode secreted proteins than found in randomly selected gene sets. Secreted proteins constitute a major means by which cells interact with their surroundings. Mounting biological evidence has identified the tumor microenvironment as a critical factor that determines tumor survival and growth. Thus, the genes identified by this study that encode secreted proteins might provide important insights to the nature of the critical biological features in the microenvironment of each tumor type that allow these cells to thrive and proliferate.     

Distributed scalable multi-robot learning using particle swarm optimization

Designing effective behavioral controllers for mobile robots can be difficult and tedious; this process can be circumvented by using online learning techniques which allow robots to generate their own controllers online in an automated fashion. In multi-robot systems, robots operating in parallel can potentially learn at a much faster rate by sharing information amongst themselves. In this work, we use an adapted version of the Particle Swarm Optimization algorithm in order to accomplish distributed online robotic learning in groups of robots with access to only local information. The effectiveness of the learning technique on a benchmark task (generating high-performance obstacle avoidance behavior) is evaluated for robot groups of various sizes, with the maximum group size allowing each robot to individually contain and manage a single PSO particle. To increase the realism of the technique, different PSO neighborhoods based on limitations of real robotic communication are tested and compared in this scenario. We explore the effect of varying communication power for one of these communication-based PSO neighborhoods. To validate the effectiveness of these learning techniques, fully distributed online learning experiments are run using a group of 10 real robots, generating results which support the findings from our simulations.     

Determining the optimum model parameters for oligosaccharide production efficiency using response surface integrated particle swarm optimization method: an experimental validation study

Abstract

Glucansucrases (GTFs) catalyzes the synthesis of α-glucans from sucrose and oligosaccharides in the presence of an acceptor sugar by transferring glucosyl units to the acceptor molecule with different linkages. The acceptor reactions can be affected by several parameters and this study aimed to determine the optimal reaction parameters for the production of glucansucrase-based oligosaccharides using sucrose and maltose as the donor and acceptor sugars, respectively via a hybrid technique of Response Surface Method (RSM) and Particle Swarm Optimization (PSO). The experimental design was performed using Central Composite Design and the tested parameters were enzyme concentration, acceptor:donor ratio and the reaction period. The optimization studies showed that enzyme concentration was the most effective parameter for the final oligosaccharides yields. The optimal values of the significant parameters determined for enzyme concentration and acceptor:donor ratio were 3.45?U and 0.62, respectively. Even the response surface plots for input parameters verified the PSO results, an experimental validation study was performed for the reverification. The experimental verification results obtained were also consistent with the PSO results. These findings will help our understanding in the role of different parameters for the production of oligosaccharides in the acceptor reactions of GTFs.