LayerNormalization¶

This is layer normalization defined in ONNX as function. The overall computation can be split into two stages. The first stage is standardization, which makes the normalized elements have zero mean and unit variances. The computation required by standardization can be described by the following equa…

Abstract Signature:

LayerNormalization(X: Tensor, Scale: Tensor, B: Tensor, axis: int, epsilon: float, stash_type: int)

Keras

API: keras.layers.LayerNormalization
Strategy: Direct Mapping

TensorFlow

API: keras.layers.LayerNormalization
Strategy: Direct Mapping