AverageGradients

Average the gradients across distributed processes.

Abstract Signature:

AverageGradients(gradients)

PyTorch

API: —
Strategy: Custom / Partial

Apple MLX

API: mlx.nn.average_gradients
Strategy: Direct Mapping
Official Docs ↗