Academy K

Gibbs Sampling

InterviewDerivationGibbs samplingMCMCconditionals

Related module: Stochastic computing and sampling

Problem statement

Gibbs sampling updates one variable at a time from its conditional distribution.

For a joint distribution P(x1,…,xn)P(x_1, \ldots, x_n):

  1. Describe the Gibbs sampling algorithm.
  2. Show that Gibbs sampling satisfies detailed balance.
  3. When does Gibbs sampling work well vs. poorly?

Practise this problem

Verify you understand it—not just that you read the answer.

Learn the foundations

The Thermodynamic Computing track covers this topic and more in depth.