LeakyReLU

class LeakyReLU(alpha, **kwargs)

Leaky version of a Rectified Linear Unit.

It allows a small gradient when the unit is not active

(18)\[\begin{split}f\left(x\right) = \left\{ \begin{array}{lr} \alpha x & : x \lt 0 \\ x & : x \geq 0 \\ \end{array} \right.\\\end{split}\]

Parameters:

alpha : float

slope coefficient for the negative half axis. Must be >= 0.

Inputs:

• data: input tensor with arbitrary shape.

Outputs:

• out: output tensor with the same shape as data.