Which SGD algorithm should you use?

You are building an Azure Machine Learning workflow by using Azure Machine Learning Studio.You create an Azure notebook that supports the Microsoft Cognitive Toolkit.
You need to ensure that the stochastic gradient descent (SGD) configuration maximizes the samples per
second and supports parallel modeling that is managed by a parameter server.
Which SGD algorithm should you use?

A.
DataParallelASGD

B.
DataParallelSGD

C.
ModelAveragingSGD

D.
BlockMomentumSGD