Academy K

02 / AI / SI Problems

AI / SI Problems

50 practice problems. How modern AI is built, trained, evaluated and constrained, from gradient descent to the superintelligence question.
Warm-up6 problems
Interview29 problems
Hard15 problems

Topics covered

AdamBPEConstitutional AIDPOKV cacheMoENLPRLRLAIFRLHFactivation functionsactivation patchingadversarialagentsalignmentarchitectureattentionbackpropagationbatch normalizationcalibrationcapabilitieschain rulecircuitsclassificationcomplexitycomputeconstitutional AIcontext lengthcontrolcorrigibilitycross-entropydebatedeceptiondecodingdeep networksdetectiondistributional shiftefficiencyemergenceevaluationfeaturesgame theorygeneralizationgradientsgrokkingimplementationinferenceinner alignmentinterpretabilitylanguage modelsloss functionsloss landscapematrix operationsmesa-optimizationmode connectivitymulti-agentnormalizationoptimizationperplexitypolicy gradientposition encodingpositional encodingpower lawspreferencesprobabilityprobingred-teamingrepresentationsreward hackingreward modelingsafetysamplingscalable oversightscalingsequencessoftmaxspecificationsuperintelligencesuperpositiontemperaturetokenizationtool usetrainingtraining dynamicstransformersvalue learningvariancewatermarking

Practise on Uncertain Systems

These problems test whether you understand the material. Uncertain Systems verifies that understanding—so you know what you actually know, not just what you read.