


- In backpropagation, you need to check if the values of the derivatives are correct.
- So you check the gradient using the technique of approximation in the gradients.
- First you set the Epsilon to a very small number and calculate the approximation value of the derivative.
- Then you compare the approximation with the actual value of the derivatives.