AverageGradientsΒΆ

Average the gradients across distributed processes.

Abstract Signature:

AverageGradients(gradients)

PyTorch

API: β€”
Strategy: Custom / Partial

Apple MLX

API: mlx.nn.average_gradients
Strategy: Direct Mapping