DCASGD

class DCASGD(momentum=0.0, lamda=0.04, **kwargs)

The DCASGD optimizer.

This class implements the optimizer described in Asynchronous Stochastic Gradient Descent with Delay Compensation for Distributed Deep Learning, available at https://arxiv.org/abs/1609.08326.

This optimizer accepts the following parameters in addition to those accepted by Optimizer.

Parameters:

momentum : float, optional

The momentum value.

lamda : float, optional

Scale DC value.