The Derivative Trick

The Derivative Trick

• q has zero slope everywhere except at zero where it is infinity
  • Bad for gradient descent
• The sigmoid is a continuous function

Previous slide

Next slide

Back to the first slide

View Graphic Version