The Lingering of Gradients: How to Reuse Gradients Over Time