Académique Documents
Professionnel Documents
Culture Documents
AbstractSince the error surface of digital infinite-impulseresponse (IIR) filters is generally nonlinear and multimodal, global
optimization techniques are required in order to avoid local minima. In this paper, a seeker-optimization-algorithm (SOA)-based
evolutionary method is proposed for digital IIR filter design. SOA
is based on the concept of simulating the act of human searching
in which the search direction is based on the empirical gradient
by evaluating the response to the position changes and the step
length is based on uncertainty reasoning by using a simple fuzzy
rule. The algorithms performance is studied with comparison of
three versions of differential evolution algorithms, four versions
of particle swarm optimization algorithms, and genetic algorithm.
The simulation results show that SOA is superior or comparable
to the other algorithms for the employed examples and can be
efficiently used for IIR filter design.
Index TermsDigital infinite-impulse-response (IIR) filter design, global optimization, heuristics, seeker optimization algorithm (SOA), system identification.
I. I NTRODUCTION
Manuscript received March 31, 2008; revised August 19, 2009. First published September 1, 2009; current version published April 14, 2010. This
work was supported in part by the National Natural Science Foundation of
China under Contract 60870004 and in part by the Doctor Student Innovation
Foundation of Southwest Jiaotong University.
C. Dai and W. Chen are with the School of Electrical Engineering, Southwest
Jiaotong University, Chengdu 610031, China (e-mail: dchzyf@yahoo.com.cn).
Y. Zhu is with the Department of Computer and Communication Engineering, Southwest Jiaotong University, Emei 614202, China.
Digital Object Identifier 10.1109/TIE.2009.2031194
DAI et al.: SEEKER OPTIMIZATION ALGORITHM FOR DIGITAL IIR FILTER DESIGN
Fig. 1.
1711
M
bi y(k i) =
i=1
L
ai x(k i)
(1)
i=0
where x(k) and y(k) are the filters input and output, respectively; M ( L) is the filter order; and bi and ai are the filter
coefficients.
The application of IIR filters in system identification has
been widely studied since many problems encountered in signal
processing can be characterized as a system-identification problem (Fig. 1) [1][3], [5], [10], [12][14]. Hence, in this paper,
IIR filters are designed for the system-identification purpose.
In this case, the parameters of the IIR filter are successively
adjusted by SOA until the error between the outputs of the
filter and the system is minimized. In other words, the task is
formulated as a minimizationoptimization problem with the
mean square error (mse) as the objective function J(w)
min J(w) = min
wW
wW
N
1
(d(k) y(k))2
N
A. Implementation of SOA
The main steps of SOA are shown in Fig. 2. In order to add a
social component for social sharing of information, a neighborhood is defined for each seeker. In the present simulations, the
population is randomly divided into three subpopulations (all
the subpopulations have the same size), and all the seekers in
the same subpopulation constitute a neighborhood. A search di
(3)
(2)
k=1
where w = [ a0 a1 aL b1 b2 bM ]T denotes
the filter coefficient vector; W represents the coefficient space;
d(k) and y(k) are the desired and actual responses of the filter,
respectively; and N is the number of samples used to calculate
the objective function.
Not all filters defined by (1) are feasible or implementable.
A causal linear time-invariant system is stable if and only
if its all poles lie inside the unit circle. Another efficient
way of maintaining stability is to convert the direct form to
a lattice form and make sure that all reflection coefficients
ki , 0 i M 1, have magnitudes that are less than one
[10]. We adopt the latter in this paper as [10] did. Thus, the
actual filter coefficient vector, namely, the real-coded solution
of SOA, is w = [ a0 a1 aL k0 k1 kM 1 ]T .
In this case, the coefficient space W is formed by the constraints
of ai [2, 2] (i = 0, . . . , L) and the magnitudes of ki (i =
0, . . . , M 1) that are less than one for the simulation study in
this paper.
III. SOA
SOA operates on a search population of s D-dimensional
position vectors, which encode the potential solutions to the op
timization problem at hand, i.e., x i = [xi1 , . . . , xij , . . . , xiD ],
i = 1, 2, . . . , s, where xij is the jth element of x i and s is
Since the subpopulations are searching using their own information, they are easy to converge to a local optimum. To
avoid this situation, an intersubpopulation learning strategy
is used, i.e., the worst two positions of each subpopulation
are combined with the best position of each of the other two
subpopulations by the following binomial crossover operator:
xlj,best ,
if Rj 0.5
xkn j,worst =
(4)
xkn j,worst , else
where Rj is a uniformly random real number within [0, 1],
xkn j,worst is denoted as the jth element of the nth worst
position in the kth subpopulation, xlj,best is the jth element
of the best position in the lth subpopulation, the indices
k, n, and l are constrained by the combination (k, n, l)
{(1, 1, 2), (1, 2, 3), (2, 1, 1), (2, 2, 3), (3, 1, 1), (3, 2, 2)}, and
j = 1, . . . , D. In this way, the good information obtained by
each subpopulation is exchanged among the subpopulations,
and then, the diversity of the population is increased.
B. Search Direction
The gradient has played an important role in the history of
search methods [25]. The search space may be viewed as a
gradient field, and a so-called empirical gradient (EG) can be
determined by evaluating the response to the position change,
particularly when the objective function is not available in a
differentiable form at all. Then, the seeker can follow an EG
1712
to guide his search. Since SOA does not involve the magnitude
of the EG, the search direction can be determined only by the
signum function of a better position minus a worse position.
(6)
(7)
pirical directions, namely, d i,ego (t), d i,alt1 (t), d i,alt2 (t), and
(0)
if rj pj
0,
(0)
(0)
(1)
dij = 1,
(9)
if pj < rj pj + pj
(0)
(1)
1, if pj + pj < rj 1
composed of the jth elements of d i,ego (t), d i,alt1 (t), d i,alt2 (t),
s Ii
(max min )
s1
(10)
DAI et al.: SEEKER OPTIMIZATION ALGORITHM FOR DIGITAL IIR FILTER DESIGN
(11)
1713
Unlike PSO and DE, SOA deals with search direction and
step length independently. Due to the use of fuzzy rule: If
{f itness value is small}, then {step length is short}, the
better the position of the seeker, the shorter his step length. As
a result, from the worst seeker to the best seeker, the search
is changed from a coarse one to a fine one so as to ensure
that the population can not only keep a good search precision
but also find new regions of the search space. Consequently,
at every time step, some seekers are better for exploration,
while some others are better for exploitation. In addition, due
to the self-organized aggregation behavior and the decreasing
parameter in (11), the feasible search range of the seekers
is decreasing with increasing time step. Hence, the population
favors exploration at the early stage and exploitation at
the late stage. In a word, both at every time step and in the
whole search process, SOA can effectively balance exploration
and exploitation, which could ensure the effectiveness and
efficiency of SOA [36].
According to [37], a nearer-is-better (NisB) property is almost always assumed: Most of the iterative stochastic optimization algorithms, if not all, at least from time to time, look around
a good point in order to find an even better one. Furthermore,
Clerc [37] also pointed out that an effective algorithm may
perfectly switch from a NisB assumption to a nearer-is-worse
(NisW) one and vice versa. We believe that SOA is potentially
provided with the NisB property because of the use of fuzzy
reasoning and can switch between a NisB assumption and a
NisW one. The main reason lies in the following two aspects.
On the one hand, the search direction of each seeker is based on
a compromise among several empirical directions, and different
seekers often learn from different empirical points on different
dimensions instead of a single good point, as mentioned by the
NisB assumption. On the other hand, the uncertainty reasoning
(fuzzy reasoning) used by SOA would let a seekers step length
uncertain, which uncertainly lets a seeker to become nearer
to a certain good point or farther away from another certain
good point. Both two aspects can boost the diversity of the
population. Hence, from Clercs point of view [37], it is further
proved that SOA is effective.
IV. S IMULATION R ESULTS
Since their proposal in 1995, PSO and DE have been receiving increasing interest from the EC community as two
of the relatively new and powerful population-based heuristic
algorithms, and they both have been successfully applied to
digital IIR filter design [11][14]. Thus, the proposed method
is compared mainly with DE, PSO, and their recently modified
versions: the original DE (DE/rand/1/bin, F = 0.5, CR = 0.9)
[38], DE with self-adapting control parameters (SACP-DE)
[38], self-adaptive DE (SaDE) [39], PSO with adaptive inertia
weight (PSO-w: learning rate c1 = c2 = 2, inertia weight linearly decreased from 0.9 to 0.4 with increasing run time, and
the maximum velocity vmax is set at 20% of the dynamic range
of the variable on each dimension) [40], PSO with constriction
factor (PSO-cf: c1 = c2 = 2.01 and constriction factor =
0.729844) [41], comprehensive learning particle swarm optimizer (its parameters follow the suggestions from [42], except
1714
TABLE I
R ESULTS OF E ACH A LGORITHM . Best, M ean, AND Std S TAND FOR THE B EST MSE OVER 30 RUNS , THE M EAN B EST MSE , AND THE
S TANDARD D EVIATION , R ESPECTIVELY, AND THE h AND CI VALUES A RE THE R ESULTS OF T -T ESTS . T HE B OLD IN THE C OLUMNS OF
Best, M ean, AND Std A RE THE B EST VALUES A MONG A LL THE A LGORITHMS , THE B OLD IN THE C OLUMNS OF h AND CI
S HOWS T HAT SOA I S S IGNIFICANTLY S UPERIOR TO THE C OMPARED M ETHODS , AND THE I TALIC IN THE C OLUMNS OF
h AND CI S HOWS T HAT SOA I S S TATISTICALLY I NFERIOR TO THE C OMPARED M ETHODS
that the refreshing gap m = 2), standard PSO 2007 (SPSO2007) [43], and GA (bit-string encoding, 20 b for each variable,
roulette-wheel selection, elitist strategy, two-point crossover
probability pc = 0.8, and mutation probability pm = 0.05) [7].
In all the experiments, the same population size popsize = 100,
except SPSO-2007 whose popsize is automatically computed
by the algorithm, a total of 30 runs, and a total number of
maximum generations of 1000 are made.
Simulation studies are carried out on seven typical examples
(see Appendix I), which are taken from [1], [2], [5], [7], [10],
and [12][14]. The best (Best), the mean (M ean), and the
standard deviation (Std) of the objective function values J(w)
of all the algorithms over 30 runs are compared. In order to
determine whether the results obtained by SOA are statistically
different from the results generated by other algorithms,
T -tests are conducted. An h value of one indicates that the
performances of the two algorithms are statistically different
with 95% certainty, whereas an h value of zero implies that the
performances are not statistically different. CI is confidence
interval. The results are summarized in Table I, where the
results for examples 4, 6, and 7 are not listed but presented
as follows. For example 4, GA has Best = 1.17 108 ,
M ean = 4.72 106 , Std = 1.01 105 , h = 1, and CI =
[8.42 106 1.02 106 ], while SPSO-2007 has
Best = 0, M ean = 1.29 1032 , Std = 7.06 1032 ,
h = 0, and CI = [3.87 1032 1.29 1032 ]. For example 6, GA has Best = 2.05 109 , M ean = 8.61
106 , Std = 7.82 106 , h = 1, and CI = [1.15
105 5.76 106 ], while SPSO-2007 has Best = 0,
M ean = 8.20 1030 , Std = 4.49 1029 , h = 0, and
CI = [2.46 1029 8.21 1030 ]. For example 7, GA
DAI et al.: SEEKER OPTIMIZATION ALGORITHM FOR DIGITAL IIR FILTER DESIGN
better than, the two modified DEs, choosing its suitable control
parameter values is a problem-dependent and time-consuming
task [38]. Its parameters used in this paper are based on
the proposed values from [38]. In our experiments, the DE
with other parameter values often has relatively unsatisfactory
performance.
Furthermore, the average evolutionary curves of all the algorithms over 30 runs are shown in Figs. 410 (see Appendix II).
Moreover, the average CPU time and generations needed for
each algorithm to achieve the fixed accuracy level in the
successful runs are shown in Table II. The successful runs
are considered, during which the algorithms achieve the fixed
accuracy within the maximum generations. From Figs. 410
and Table II, it is indicated that SOA has good convergence
performance to achieve the fixed accuracy level with acceptable
computation time and generations. Although SPSO-2007 often
needs less computing time due to its small population size, it
also has fewer successful runs.
In addition, the minimax error criterion was employed to
design digital IIR filters using the same examples, and we found
that the commensurate results can be obtained.
V. C ONCLUSION
The SOA is a novel heuristic stochastic optimization algorithm based on simulating the act of human searching. The
algorithm has the additional advantages of being easy to understand and simple to implement so that it can be used for a
wide variety of design and optimization tasks. In this paper, an
SOA-based digital filter design method has been proposed, and
the benefits of SOA for designing digital IIR filters have been
studied. The simulation results show that SOA has better, or at
least equivalent, global search ability and convergence speed
than GA, four PSOs, and three DEs for most of the chosen and
widely used problems in this paper. Thus, it is believed that
the proposed algorithm is capable of quickly and effectively
adapting the coefficients of a wide variety of IIR structures and
will become a promising candidate for digital filter design.
A PPENDIX I
Example 1: This example is taken from [1], [2], [5],
[10], and [12]. The system and filter transfer functions are,
respectively,
0.05 0.4z 1
1 1.1314z 1 + 0.25z 2
a0
Hf (z) =
.
1 + b1 z 1
Hs (z) =
The input x(k) to the system and the filter was a white-noise
sequence. The data length was N = 100.
Example 2: This example is taken from [5] and [10]
Hs (z) =
Hf (z) =
a0 + a1 z 1
.
1 + b1 z 1 + b2 z 2
1715
1716
The system input was a uniformly distributed white-noise sequence, taking values from (0.5, 0.5); SN R = 30 dB; and
N = 100.
Example 3: This example is taken from [5] and [7]
Hs (z) =
Hf (z) =
a0 + a1 z 1 + + a5 z 5
.
1 + b1 z 1 + + b5 z 5
1 1.2z 1 + 0.6z 2
a0
Hf (z) =
.
1 + b1 z 1 + b2 z 2
The system input was a unit-variance white Gaussian
pseudonoise sequence, and N = 100.
Fig. 9.
Fig. 10.
1.25z 1 0.25z 2
1 0.3z 1 + 0.4z 2
Hf (z) =
a0 + a1 z 1 + a2 z 2
.
1 + b1 z 1 + b2 z 2
DAI et al.: SEEKER OPTIMIZATION ALGORITHM FOR DIGITAL IIR FILTER DESIGN
1717
TABLE II
R ESULTS OF E ACH A LGORITHM TO ACHIEVE THE F IXED ACCURACY L EVEL OVER 30 RUNS
Colored inputs were generated by filtering a white-noise sequence by an FIR filter Hc (z) = (1 0.6z 1 )2 (1 + 0.6z 1 )2 .
N = 2000.
A PPENDIX II
See Figs. 410.
R EFERENCES
[1] N. Karaboga, A. Kalinli, and D. Karaboga, Designing IIR filters using
ant colony optimisation algorithm, J. Eng. Appl. Artif. Intell., vol. 17,
no. 3, pp. 301309, Apr. 2004.
[2] A. Kalinli and N. Karaboga, Artificial immune algorithm for IIR filter
design, J. Eng. Appl. Artif. Intell., vol. 18, no. 5, pp. 919929, Dec. 2005.
[3] J. Luukko and K. Rauma, Open-loop adaptive filter for power electronics
applications, IEEE Trans. Ind. Electron., vol. 55, no. 2, pp. 910917,
Feb. 2008.
[4] S. H. Ling, H. H. C. Iu, F. H. F. Leung, and K. Y. Chan, Improved
hybrid particle swarm optimized wavelet neural network for modeling the
development of fluid dispensing for electronic packaging, IEEE Trans.
Ind. Electron., vol. 55, no. 9, pp. 34473460, Sep. 2008.
[5] A. Kalinli and N. Karaboga, A new method for adaptive IIR filter design based on Tabu search algorithm, Int. J. Electron. Commun. (AE),
vol. 59, no. 2, pp. 111117, 2005.
[6] K. S. Tang, K. F. Man, S. Kwong, and Z. F. Liu, Design and optimization
of IIR filter structure using hierarchical genetic algorithms, IEEE Trans.
Ind. Electron., vol. 45, no. 3, pp. 481487, Jun. 1998.
[7] M. S. White and S. J. Flockton, Adaptive recursive filtering using evolutionary algorithms, in Evolutionary Algorithms in Engineering Applications, D. Dasgupta and Z. Michalewicz, Eds. Berlin, Germany:
Springer-Verlag, 1997, pp. 361376.
[8] J.-T. Tsai, J.-H. Chou, and T.-K. Liu, Optimal design of digital IIR filters
by using hybrid Taguchi genetic algorithm, IEEE Trans. Ind. Electron.,
vol. 53, no. 3, pp. 867879, Jun. 2006.
[9] Y. Yu and Y. Xinjie, Cooperative coevolutionary genetic algorithm for
digital IIR filter design, IEEE Trans. Ind. Electron., vol. 54, no. 3,
pp. 13111318, Jun. 2007.
[10] S. Chen, R. H. Istepanian, and B. L. Luk, Digital IIR filter design using
adaptive simulated annealing, Digit. Signal Process., vol. 11, no. 3,
pp. 241251, Jul. 2001.
[11] R. Storn, Designing nonstandard filters with differential evolution,
IEEE Signal Process. Mag., vol. 22, no. 1, pp. 103106, Jan. 2005.
[12] N. Karaboga, Digital IIR filter design using differential evolution algorithm, EURASIP J. Appl. Signal Process., vol. 2005, no. 8, pp. 1269
1276, Jan. 2005.
[13] D. J. Krusienski and W. K. Jenkins, Particle swarm optimization for
adaptive IIR filter structures, in Proc. Congr. Evol. Comput., Jun. 2004,
pp. 965970.
[14] D. J. Krusienski and W. K. Jenkins, Design and performance of adaptive
systems based on structured stochastic optimization, IEEE Circuits Syst.
Mag., vol. 5, no. 1, pp. 820, Mar. 2005.
[15] J. Timmis, T. Knight, L. N. de Castro, and E. Hart, An Overview of Artificial Immune Systems, R. Paton, H. Bolouri, M. Holcombe, J. H. Parish,
and R. Tateson, Eds. Berlin, Germany: Springer-Verlag, 2004, ser. Computation in Cells and Tissues: Perspectives and Tools for Thought-Natural
Computation Series, pp. 5186.
[16] I. I. Garibay, The proteomics approach to evolutionary computation: An
analysis of proteome-based location independent representations based
on the proportional genetic algorithm, Ph.D. dissertation, Comput. Sci.
School, College Eng. Comput. Sci., Univ. Central Florida, Orlando, FL,
2004.
[17] M. Dorigo, V. Maniezzo, and A. Colorni, The ant system: Optimization
by a colony of cooperating agents, IEEE Trans. Syst., Man, Cybern. B,
Cybern., vol. 26, no. 1, pp. 2941, Feb. 1996.
[18] C. F. Juang, C. M. Lu, C. Lo, and C.-Y. Wang, Ant colony optimization
algorithm for fuzzy controller design and its FPGA implementation,
IEEE Trans. Ind. Electron., vol. 55, no. 3, pp. 14531462, Mar. 2008.
[19] Z. Fan, J. Liu, T. Srensen, and P. Wang, Improved differential evolution based on stochastic ranking for robust layout synthesis of MEMS
components, IEEE Trans. Ind. Electron., vol. 56, no. 4, pp. 937948,
Apr. 2009.
[20] A. Nobakhti and H. Wang, A simple self-adaptive differential evolution
algorithm with application on the ALSTOM gasifier, Appl. Soft Comput.,
vol. 8, no. 1, pp. 350370, Jan. 2008.
[21] D. Zaharie, Control of population diversity and adaptation in differential
evolution algorithms, in Proc. 9th Int. Conf. Soft Comput., R. Matousek
and P. Osmera, Eds., 2003, pp. 4146.
[22] L. dos Santos Coelho and B. M. Herrera, Fuzzy identification based on a
chaotic particle swarm optimization approach applied to a nonlinear yo-yo
motion system, IEEE Trans. Ind. Electron., vol. 54, no. 6, pp. 32343245,
Dec. 2007.
[23] B. Biswal, P. K. Dash, and B. K. Panigrahi, Power quality disturbance
classification using fuzzy C-means algorithm and adaptive particle swarm
optimization, IEEE Trans. Ind. Electron., vol. 56, no. 1, pp. 212220,
Jan. 2009.
[24] C. Dai, Y. Zhu, and W. Chen, Seeker optimization algorithm, in Computational Intelligence and Security, vol. 4456, Lecture Notes in Artificial
Intelligence, Y. Wang, Y. Cheung, and H. Liu, Eds. Berlin, Germany:
Springer-Verlag, 2007, pp. 167176.
[25] J. D. Hewlett, B. M. Wilamowski, and G. Dndar, Optimization using a
modified second-order approach with evolutionary enhancement, IEEE
Trans. Ind. Electron., vol. 55, no. 9, pp. 33743380, Sep. 2008.
[26] V. Kumar and F. Sahin, Cognitive maps in swarm robots for the mine
detection application, in Proc. IEEE Int. Conf. Syst., Man, Cybern., 2003,
vol. 4, pp. 33643369.
[27] D. Eustace, D. P. Barnes, and J. O. Gray, Co-operant mobile robots
for industrial applications, in Proc. Int. Conf. Ind. Electron., Control,
Instrum., 1993, vol. 1, pp. 3944.
[28] Y. del Valle, G. K. Venayagamoorthy, S. Mohagheghi, J. C. Hernandez,
and R. G. Harley, Particle swarm optimization: Basic concepts, variants
and applications in power systems, IEEE Trans. Evol. Comput., vol. 12,
no. 2, pp. 171195, Apr. 2008.
[29] V. Trianni, R. Gro, T. H. Labella, E. Sahin, and M. Dorigo, Evolving aggregation behaviors in a swarm of robots, in Proc. ECAL,
vol. 2801, LNAI, W. Banzhaf, T. Christaller, P. Dittrich, J. T. Kim, and
J. Ziegler, Eds., 2003, pp. 865874.
[30] M. Wooldridge and N. R. Jennings, Intelligent agents: Theory and practice, Knowl. Eng. Rev., vol. 10, no. 2, pp. 115152, 1995.
[31] I. Ajzen, Residual effects of past on later behavior: Habituation and
reasoned action perspectives, Personal. Soc. Psychol. Rev., vol. 6, no. 2,
pp. 107122, 2002.
[32] B. Raphael and I. F. C. Smith, A direct stochastic algorithm for
global search, Appl. Math. Comput., vol. 146, no. 2/3, pp. 729758,
Dec. 2003.
1718
Chaohua Dai received the Ph.D. degree in electric system control and information technique from
Southwest Jiaotong University, Chengdu, China,
in 2009.
He is currently an Associate Professor in
the School of Electrical Engineering, Southwest
Jiaotong University. His research interests include
computational intelligence, multiobjective optimization, pattern recognition, and intelligent monitoring
and control.
Yunfang Zhu received the M.Sc. degree in measuring and control technology and instrumentation from Southwest Jiaotong University, Chengdu,
China, in 2005.
She is currently an Associate Professor in the
Department of Computer and Communication Engineering, Southwest Jiaotong University, Emei,
China. Her research interests include neural networks, evolutionary algorithms, signal processing,
and intelligent control.