Interactive Markov Models of Optimization Search Strategies

This paper introduces a Markov model for evolutionary algorithms (EAs) that is based on interactions among individuals in the population. This interactive Markov model has the potential to provide tractable models for optimization problems of realistic size. We propose two simple discrete optimization search strategies with population-proportion-based selection and a modified mutation operator. The probability of selection is linearly proportional to the number of individuals at each point of the search space. The mutation operator randomly modifies an entire individual rather than a single decision variable. We exactly model these optimization search strategies with interactive Markov models. We present simulation results to confirm the interactive Markov model theory. We show that genetic algorithms and biogeography-based optimization perform better with the addition of population-proportion-based selection on a set of real-world benchmarks. We note that many other EAs, both new and old, might be able to be improved with this addition, or modeled with this method.