Can you explain the behavior of the Swish activation function?

AAWEG I *We put ghosts in machines *
1 min readApr 20

The Swish activation function is a relatively new activation function that has gained popularity in deep learning neural networks. It was introduced by researchers at Google in 2017.

The Swish activation function is defined as follows:

f(x) = x * sigmoid(beta * x)
AAWEG I *We put ghosts in machines *

Written by AAWEG I *We put ghosts in machines *

403 Followers

linkedin.com/in/aaweg-i | github.com/the-ogre

More from AAWEG I *We put ghosts in machines *

See all from AAWEG I *We put ghosts in machines *

Lists

What is ChatGPT?

Staff Picks

See more recommendations