Gradient checkpointing

Also known as Activation checkpointing, Rematerialization. This is the canonical page; those names redirect here.

The same recompute-versus-store trade-off as revolve checkpointing in reverse-mode automatic differentiation; see the automatic-differentiation problem.