RMSNormalization

Root Mean Square (RMS) Normalization layer.

Abstract Signature:

RMSNormalization(axis: int = -1, epsilon: float = 1e-6)

PyTorch

API: torch.nn.RMSNorm
Strategy: Direct Mapping
Official Docs ↗

Keras

API: keras.layers.RMSNormalization
Strategy: Direct Mapping
Official Docs ↗

TensorFlow

API: tf.keras.layers.RMSNormalization
Strategy: Direct Mapping
Official Docs ↗

Apple MLX

API: mlx.nn.RMSNorm
Strategy: Direct Mapping
Official Docs ↗

Flax NNX

API: flax.nnx.RMSNorm
Strategy: Direct Mapping
Official Docs ↗

PaxML / Praxis

API: praxis.layers.RMSNorm
Strategy: Direct Mapping
Official Docs ↗