RMSNormalization¶
This is RMS normalization defined in ONNX as function as described in the paper https://arxiv.org/pdf/1910.07467. The overall computation can be split into two stages. The root mean squared norm is taken over the last D dimensions, where D is the dimension of normalized_shape. For example, if normal…
Abstract Signature:
RMSNormalization(X: Tensor, scale, axis: int, epsilon: float, stash_type: int)