To add, one could think of schemes like "momentum" and cousins as attempts to es...

		ssivark on April 14, 2022 \| parent \| context \| favorite \| on: Differentiable Programming – A Simple Introduction To add, one could think of schemes like "momentum" and cousins as attempts to estimate something in the spirit of the inverse Hessian using various hacks/heuristics.