Gradient Gives Back