Academy K

Restricted Boltzmann Machine

InterviewDerivationRBMBoltzmann machinesbipartite

Related module: Ising models and Boltzmann machines

Problem statement

A Restricted Boltzmann Machine (RBM) has visible units vv and hidden units hh with no within-layer connections.

The energy is:

E(v,h)=−vTWh−bTv−cThE(v, h) = -v^TWh - b^Tv - c^Th

  1. Show that the conditional distributions P(h∣v)P(h|v) and P(v∣h)P(v|h) factor.
  2. Derive the form of P(hj=1∣v)P(h_j = 1 | v) for binary units.
  3. Why does the restricted structure make inference tractable?

Hints

Practise this problem

Verify you understand it—not just that you read the answer.

Learn the foundations

The Thermodynamic Computing track covers this topic and more in depth.