Homepage



  » Welcome
  » About
  » Hosting

  General AI



  » Introductions
  » Finite State Machines
  » Ameliorated Future
  » Miscellaneous

  Neural Networks



  » Introductions
  » Backpropagation
  » Optimization
  » Simulators
  » Applied NNs
  » Sample Code
  » Image Recognition
  » Image Compression

  Artificial Life



  » Tutorials
  » Sample Code

  Genetic Algorithms



  » Libraries
  » Sample Code

  Fuzzy Logic



  » FAQ

  Games



  » Sample Code

  Reinforcement Learning



  » Tutorials
  » FAQ

You are in: Neural Networks  /  Backpropagation  /  Step function backprop
Step function backprop

In order to apply backpropagation, the activation function needs to be derivable. Unfortunately, when the activation function is a step function, it cannot be derived. A workaround is to use a sigmoid activation function with a steep curve.

1/(1+exp(-ax))

Make a as large as you want for the curve to be steep enough.






Download Article
Printer Friendly
Back


All content copyrighted by Avaye.com