Factors Impacting Landscape Ruggedness in Control Problems

Abstract # ↰

Understanding fitness landscapes in evolutionary robotics (ER) can provide valuable insights into the considered robotic problems as well as into the strategies found by Evolutionary algorithms (EAs) to address them, ultimately guiding practitioners toward better design choices. However, most studies on fitness landscape analysis have been conducted on theoretical benchmarks, lacking direct relevance to practical robotics applications. This work aims to bridge this gap by (i) gathering a variety of measures to assess the ruggedness of a fitness landscape, (ii) validating them on a simple benchmark problem with a known and tunable fitness landscape, and (iii) applying these measures to a continuous control problem—a robotic navigation task. Using a highly customisable task, we investigate how various factors, including environmental conditions (i.e., the arena configuration), agent perception (i.e., the robot sensors), controller design (i.e., the structure of the artificial neural network controlling the robot), and fitness shaping (i.e., how the robot is rewarded for its behaviour) influence the ruggedness of the fitness landscape. Our findings suggest that simple measures can be sufficiently informative of the ruggedness of a given fitness landscape.Regarding the considered factors, we find that the ruggedness is primarily affected by the fitness shaping, followed by the controller features, while other factors tend to have a minor impact.