Implementing Adam Optimizer
InterviewCodingoptimizationAdamtraining
Related module: Learning from data and backpropagation
Problem statement
Implement the Adam optimizer from scratch in NumPy.
Adam combines momentum (first moment) and RMSprop (second moment) with bias correction.
Include the update equations and implement the step() method.