This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Genetic Search: Analysis Using Fitness Moments
February 1996 (vol. 8 no. 1)
pp. 120-133

Abstract—Genetic Algorithms are efficient and robust search methods that are being employed in a plethora of applications with extremely large search spaces. The directed search mechanism employed in Genetic Algorithms performs a simultaneous and balanced, exploration of new regions in the search space and exploitation of already discovered regions.

This paper introduces the notion of fitness moments for analyzing the working of Genetic Algorithms (GAs). We show that the fitness moments in any generation may be predicted from those of the initial population. Since a knowledge of the fitness moments allows us to estimate the fitness distribution of strings, this approach provides for a method of characterizing the dynamics of GAs. In particular the average fitness and fitness variance of the population in any generation may be predicted.

We introduce the technique of fitness-based disruption of solutions for improving the performance of GAs. Using fitness moments, we demonstrate the advantages of using fitness-based disruption. We also present experimental results comparing the performance of a standard GA and GAs (CDGA and AGA) that incorporate the principle of fitness-based disruption. The experimental evidence clearly demonstrates the power of fitness based disruption.

[1] J.D. Schaffer and A Morishma,"An adaptive crossover mechanism for genetic algorithms," Proc. Second Int'l Conf. Genetic Algorithms, pp. 36-40, 1987.
[2] J. Baker,"Reducing bias and inefficiency in the selection algorithms," Proc. Second Int'l Conf. Genetic Algorithms, MIT, pp. 14-21, July28-31, 1987.
[3] Proc. Fourth Int'l Conf. Genetic Algorithms, pp. 77-84, R. Belew, ed., Morgan Kaufmann, 1991.
[4] C.L. Bridges and D.E. Goldberg,"An analysis of reproduction and crossover in a binary coded genetic algorithm" Proc.. Second Int'l Conf. Genetic Algorithms, J.J. Grefenstette, ed., 1987.
[5] L. Davis,"Bit climbing, representational bias, and test suite design" in Proc. Fourth Int'l Conf. Genetic Algorithms, pp. 18-23.
[6] L Davis,"Adapting operator probabilities in genetic algorithms," Proc. Third Int'l Conf. of Genetic Algorithms, pp. 61-69, 1989.
[7] K.A. DeJong,"An analysis of the behaviour of a class of genetic adaptive systems," PhD dissertation, University of Michigan, 1975.
[8] L.J. Eshelman,"The CHC adaptive search algorithm: how to have safe search when engaging in nontraditional genetic recombination," Proc. Foundations of Genetic Algorithms Conf., pp. 265-283, G. Rawlins, ed., Morgan Kaufmann, 1991.
[9] T.C. Fogarty,"Varying the probability of mutation in genetic algorithms," Proc. Third Int'l Conf. Genetic Algorithms, pp. 104-109, 1989.
[10] D.E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning. Reading, Mass.: Addison-Wesley, 1989.
[11] D.E. Goldberg and P. Sergest,"Finite Markov chain analysis of genetic algorithms," Proc. Second Int'l Conf. Genetic Algorithms, pp. 1-8, J.J. Grefenstette, ed., 1987.
[12] D.E Goldberg,"Real-coded genetic algorithms, virtual codes, and blocking," Univ. Illinois at Urbana Champaign, Technical Report No. 90001, 1990.
[13] D. E. Goldberg,"Genetic algorithms and walsh functions: Part II, deception and its analysis," Complex Systems, vol. 3, pp. 153-171, 1989.
[14] J. Grefenstette, “Optimization of Control Parameters for Genetic Algorithms,” IEEE Trans. Systems, Man, and Cybernetics, vol. 16, no. 1, pp. 122-128, 1986.
[15] J.H. Holland, Adaptation in Natural and Artificial Systems. Univ. of Michigan Press, 1975.
[16] O.H. Ibarra and S.K. Sahni,"Polynomially complete fault detection problems," IEEE Trans. Computers, vol. 24, pp. 242-247, Mar. 1975.
[17] "Special session: Recent algorithms for gate-level ATPG with fault simulation and their performance assessment," Proc. 1985 IEEE Int. Symp. Circuits and Systems (ISCAS), pp. 663-698, June 1985.
[18] A.E. Nix and M.D. Vose,"Modeling genetic algorithms with Markov chains," Annals of Mathematics and Artificial Intelligence, no. 5, pp. 77-88, 1992.
[19] J.D. Schaffer,"A study of control parameters affecting online performance of genetic algorithms for function optimization" Proc. Third Int'l Conf. Genetic Algorithms, pp. 51-60, 1989.
[20] J.D. Schaffer,"Some effects of selection procedures on hyperplane sampling by genetic algorithms," L. Davis, ed., Genetic Algorithms and Simulated Annealing. Morgan Kaufmann, 1991.
[21] N. Schraudolph and R. Belew,"Dynamic parameter encoding for genetic algorithms," Technical Report No. LA-UR-90-2775, Los Alamos National Lab, 1991.
[22] C. Shaefer,"The ARGOT strategy: Adaptive representative genetic optimizer technique," Proc. Second Int'l. Conf Genetic Algorithms, 1987.
[23] M. Srinivas and L. Patnaik, "Adaptive Probabilities of Crossover and Mutation in Genetic Algorithm," IEEE Trans. System, Man, and Cybernetics, vol. 24, no. 4, Apr. 1994.
[24] M. Srinivas and L.M. Patnaik,"Genetic algorithms: A survey," Computer, pp. 17-26, June 1994.
[25] M. Srinivas and L.M Patnaik,"Learning neural network weights using genetic algorithms—Improving performance by search space reduction," Proc. 1991 IEEE Int'l Joint Conf. Neural Networks,Singapore, pp. 18-21, 1991.
[26] M. Srinivas and L.M Patnaik,"A simulation-based test generation scheme using genetic algorithms," Proc. Sixth Int'l Conf. VLSI Design. IEEE Computer Society Press, pp. 132-135, Jan. 1993.
[27] M. Srinivas and L.M Patnaik,"Binomially distributed populations for modeling genetic algorithms" Proc. Fifth Int'l Conf. Genetic Algorithms. Morgan Kaufmann, July 1993.
[28] M. Srinivas and L.M Patnaik,"On an exact populationary model of genetic algorithms," to appear in Information Sciences.
[29] G. Syswerda,"Uniform crossover in genetic algorithms," Proc. Third Int'l Conf. Genetic Algorithms, pp. 2-9, 1989.
[30] T.E. Davis,"A simulated annealing like convergence theory for the simple genetic algorithm," Proc. Fourth Int'l Conf. Genetic Algorithms, pp.174-181.
[31] M.D. Vose and G. Liepins,"Punctuated equilibria in genetic search," Complex Systems, vol. 5, pp. 31-44, 1991.
[32] D. Whitley,"Delta coding: An iterative search strategy for genetic algorithms," Proc. Fourth Int'l Conf. Genetic Algorithms, pp. 77-84.
[33] D. Whitley and T. Starkweather,"Genitor-II: A distributed genetic algorithm," J. Expt. Theor. Artif. Int., vol. 2, pp. 189-214, 1990.

Index Terms:
Search methods, genetic algorithms, fitness moments, adaptive variation of parameters, controlled disruption.
Citation:
M. Srinivas, L.m. Patnaik, "Genetic Search: Analysis Using Fitness Moments," IEEE Transactions on Knowledge and Data Engineering, vol. 8, no. 1, pp. 120-133, Feb. 1996, doi:10.1109/69.485641
Usage of this product signifies your acceptance of the Terms of Use.