SinusoidalPositionalEncoding

Injects sinusoidal positional encodings.

Abstract Signature:

SinusoidalPositionalEncoding(dims: int, min_freq: float = 0.0001)

PyTorch

API: —
Strategy: Custom / Partial

Apple MLX

API: mlx.nn.SinusoidalPositionalEncoding
Strategy: Direct Mapping
Official Docs ↗