RMSNorm

Applies Root Mean Square Normalization.

Abstract Signature:

RMSNorm(dim: int, eps: float = 1e-5)

PyTorch

API: torch.nn.RMSNorm
Strategy: Direct Mapping
Official Docs ↗

Keras

API: keras.layers.RMSNormalization
Strategy: Direct Mapping
Official Docs ↗

TensorFlow

API: tf.keras.layers.RMSNormalization
Strategy: Direct Mapping
Official Docs ↗

Apple MLX

API: mlx.nn.RMSNorm
Strategy: Direct Mapping
Official Docs ↗

Flax NNX

API: flax.nnx.RMSNorm
Strategy: Direct Mapping
Official Docs ↗

PaxML / Praxis

API: praxis.layers.RMSNorm
Strategy: Direct Mapping
Official Docs ↗