Academy K

Mode Connectivity in Loss Landscapes

HardConceptualloss landscapemode connectivityoptimization

Related module: Deep learning fundamentals

Problem statement

Mode connectivity refers to the structure connecting different minima in the loss landscape.

  1. What is mode connectivity and what does it imply about loss landscapes?
  2. Distinguish between linear mode connectivity and path connectivity.
  3. How is mode connectivity related to neural network trainability?

Practise this problem

Verify you understand it—not just that you read the answer.

Learn the foundations

The AI / SI track covers this topic and more in depth.