03 / Thermodynamic Problems
Thermodynamic Computing Problems
50 practice problems. Probabilistic hardware, energy-based models and what a bit costs in joules.
Warm-up6 problems
- 01→
Boltzmann Distribution Basics
DerivationBoltzmann distributionstatistical mechanics - 02→
Entropy as Information
Derivationentropyinformation theory - 03→
Stochastic Computing Basics
Conceptualstochastic computingprobability encoding - 04→
Energy-Based Model Definition
Conceptualenergy-based modelspartition function - 05→
Entropy Production Bounds
Derivationentropy productionsecond lawirreversibility - 06→
Boltzmann Machine Energy Functions
DerivationBoltzmann machineenergy functionprobability
Interview23 problems
- 01→
Free Energy and Equilibrium
Derivationfree energyequilibriumvariational - 02→
Landauer's Principle
DerivationLandauerirreversible computingheat - 03→
Reversible Logic Gates
Conceptualreversible computingToffoliLandauer - 04→
Metropolis-Hastings Algorithm
DerivationMCMCMetropolissampling - 05→
Gibbs Sampling
DerivationGibbs samplingMCMCconditionals - 06→
Markov Chain Mixing Time
Conceptualmixing timeMCMCconvergence - 07→
Simulated Annealing
Conceptualannealingoptimizationtemperature - 08→
Contrastive Divergence Training
Derivationcontrastive divergencetrainingRBM - 09→
Restricted Boltzmann Machine
DerivationRBMBoltzmann machinesbipartite - 10→
Hopfield Network as Energy Model
DerivationHopfield networkassociative memoryenergy - 11→
Probabilistic Bits (p-bits)
Conceptualp-bitprobabilistic hardwarenoise - 12→
Energy Cost of Neural Network Inference
Derivationenergyinferenceefficiency - 13→
Implementing Gibbs Sampling
CodingGibbs samplingimplementationIsing model - 14→
Langevin Dynamics Sampling
CodingLangevin dynamicssamplinggradient - 15→
Fokker-Planck Equation for Probability Evolution
DerivationFokker-Planckdiffusionprobability - 16→
Kramers Escape Rate
DerivationKramers ratebarrier crossingmetastability - 17→
Stochastic Resonance
Conceptualstochastic resonancenoisesignal detection - 18→
Jarzynski Equality: Derivation and Application
DerivationJarzynski equalityfree energywork - 19→
Noise-Limited Computation Precision
Derivationnoiseprecisionanalog computing - 20→
Implementing Boltzmann Sampling
System DesignBoltzmann samplingMCMCphysical implementation - 21→
Metropolis Algorithm Thermodynamics
DerivationMetropolisdetailed balanceMCMC - 22→
Stochastic Computing Fundamentals
Derivationstochastic computingnoisemultiplication - 23→
Thermal Ratchets and Directed Motion
Conceptualratchetnonequilibriummolecular motors
Hard21 problems
- 01→
Ising Model Phase Transition
ConceptualIsing modelphase transitioncritical temperature - 02→
Computing with Noise
Conceptualanalog computingnoisecomputation - 03→
Learning in Boltzmann Machines
DerivationBoltzmann machinelearning rulegradient - 04→
Score Matching for EBMs
Derivationscore matchingenergy-based modelstraining - 05→
Diffusion Models as Physics
Conceptualdiffusion modelsSDEthermodynamics - 06→
Thermodynamic Limits on AI
DerivationthermodynamicsAIfundamental limits - 07→
Implementing an RBM
CodingRBMimplementationCD - 08→
Analog Matrix Multiplication
Conceptualanalog computingcrossbarefficiency - 09→
Neuromorphic vs Thermodynamic Computing
Conceptualneuromorphicthermodynamiccomparison - 10→
The Energy-Performance Frontier
Conceptualefficiencyscalingtrade-offs - 11→
Crooks Fluctuation Theorem
DerivationCrooks theoremfluctuation theoremtime reversal - 12→
Information Engine Design
System Designinformation enginefeedback controlMaxwell demon - 13→
Thermodynamic Neural Networks
System Designneural networksanalog computingenergy-based models - 14→
Optimal Erasure Protocols
DerivationLandauererasureoptimal protocols - 15→
Analog Gradient Descent
System Designgradient descentanalog computingoptimization - 16→
Fluctuation Theorems for Computing
Derivationfluctuation theoremcomputingentropy - 17→
Learning in Boltzmann Machines
DerivationBoltzmann machinelearningcontrastive divergence - 18→
Optimal Annealing Schedules
Derivationannealingoptimizationthermodynamics - 19→
Physical Ising Solvers
System DesignIsing machinesoptimizationhardware - 20→
Work Extraction from Correlated Systems
Derivationwork extractioncorrelationsinformation - 21→
Thermodynamic Depth and Complexity
Conceptualcomplexityentropycomputation
Topics covered
AIBoltzmann distributionBoltzmann machineBoltzmann machinesBoltzmann samplingCDCrooks theoremFokker-PlanckGibbs samplingHopfield networkIsing machinesIsing modelJarzynski equalityKramers rateLandauerLangevin dynamicsMCMCMaxwell demonMetropolisRBMSDEToffolianalog computingannealingassociative memorybarrier crossingbipartitecomparisoncomplexitycomputationcomputingconditionalscontrastive divergenceconvergencecorrelationscritical temperaturecrossbardetailed balancediffusiondiffusion modelsefficiencyenergyenergy functionenergy-based modelsentropyentropy productionequilibriumerasurefeedback controlfluctuation theoremfree energyfundamental limitsgradientgradient descenthardwareheatimplementationinferenceinformationinformation engineinformation theoryirreversibilityirreversible computinglearninglearning rulemetastabilitymixing timemolecular motorsmultiplicationneural networksneuromorphicnoisenonequilibriumoptimal protocolsoptimizationp-bitpartition functionphase transitionphysical implementationprecisionprobabilistic hardwareprobabilityprobability encodingratchetreversible computingsamplingscalingscore matchingsecond lawsignal detectionstatistical mechanicsstochastic computingstochastic resonancetemperaturethermodynamicthermodynamicstime reversaltrade-offstrainingvariationalworkwork extraction
Practise on Uncertain Systems
These problems test whether you understand the material. Uncertain Systems verifies that understanding—so you know what you actually know, not just what you read.