Academy K

Metropolis-Hastings Algorithm

InterviewDerivationMCMCMetropolissampling

Related module: Stochastic computing and sampling

Problem statement

The Metropolis-Hastings algorithm samples from a target distribution P(x)P(x) using a proposal distribution Q(x′∣x)Q(x'|x).

  1. State the Metropolis-Hastings acceptance probability.
  2. Prove that this satisfies detailed balance with P(x)P(x).
  3. For symmetric proposals (Q(x′∣x)=Q(x∣x′)Q(x'|x) = Q(x|x')), simplify the acceptance rule.

Hints

Practise this problem

Verify you understand it—not just that you read the answer.

Learn the foundations

The Thermodynamic Computing track covers this topic and more in depth.