Academy K

Analog Gradient Descent

HardSystem Designgradient descentanalog computingoptimization

Related module: Algorithmic primitives

Problem statement

Physical systems can implement gradient descent through natural dynamics.

  1. How does overdamped dynamics relate to gradient descent?
  2. Design a physical system that minimizes a quadratic loss function.
  3. What limits the precision and convergence of analog gradient descent?

Practise this problem

Verify you understand it—not just that you read the answer.

Learn the foundations

The Thermodynamic Computing track covers this topic and more in depth.