GeluFastApprox

A fast approximation to GELU (Sigmoid based).

Abstract Signature:

GeluFastApprox(x: Tensor)

PyTorchApple MLX

PyTorch

API: —

Strategy: Macro '{x} * torch.sigmoid(1.702 * {x})'

Apple MLX

API: mlx.nn.gelu_fast_approx

Strategy: Direct Mapping

Official Docs ↗