Optimization Landscape

The shape of the objective function surface over the parameter space. Understanding the optimization landscape — its local minima, saddle points, and curvature — is important for robot learning. Deep neural networks have complex, high-dimensional optimization landscapes; initialization, architecture, and optimizer choice affect which region of the landscape is explored.