Analog Gradient Descent
HardSystem Designgradient descentanalog computingoptimization
Related module: Algorithmic primitives
Problem statement
Physical systems can implement gradient descent through natural dynamics.
- How does overdamped dynamics relate to gradient descent?
- Design a physical system that minimizes a quadratic loss function.
- What limits the precision and convergence of analog gradient descent?
Learn the foundations
The Thermodynamic Computing track covers this topic and more in depth.