Learning in Boltzmann Machines
HardDerivationBoltzmann machinelearning rulegradient
Related module: Ising models and Boltzmann machines
Problem statement
A Boltzmann machine with visible units and hidden units has energy:
where are all units.
- Derive the gradient of the log-likelihood with respect to .
- What are the "positive" and "negative" phases of learning?
- Why is training general Boltzmann machines hard?
Learn the foundations
The Thermodynamic Computing track covers this topic and more in depth.