Free Energy and Equilibrium
InterviewDerivationfree energyequilibriumvariational
Related module: Entropy, information and heat
Problem statement
The Helmholtz free energy is where is average energy and is entropy.
- Show that the Boltzmann distribution minimizes free energy.
- Write the free energy for a general distribution and show .
- How does this relate to variational inference in machine learning?
Hints
Learn the foundations
The Thermodynamic Computing track covers this topic and more in depth.