Contrastive Divergence Training
InterviewDerivationcontrastive divergencetrainingRBM
Related module: Energy-based models
Problem statement
Contrastive Divergence (CD) is an approximate algorithm for training energy-based models.
- Derive the gradient of the log-likelihood for an EBM.
- Why is this gradient intractable?
- How does CD-k approximate this gradient?
Learn the foundations
The Thermodynamic Computing track covers this topic and more in depth.