MSRAPrelu

class MSRAPrelu(factor_type='avg', slope=0.25)

Initialize the weight according to a MSRA paper.

This initializer implements Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification, available at https://arxiv.org/abs/1502.01852.

This initializer is proposed for initialization related to ReLu activation, it makes some changes on top of Xavier method.

Parameters:

factor_type: str, optional

Can be 'avg', 'in', or 'out'.

slope: float, optional

initial slope of any PReLU (or similar) nonlinearities.