GLU

Applies the Gated Linear Unit function.

Abstract Signature:

GLU(dim: int = -1)

PyTorch

API: torch.nn.GLU
Strategy: Direct Mapping
Official Docs ↗

Keras

API: keras.activations.glu
Strategy: Direct Mapping
Official Docs ↗

Apple MLX

API: mlx.nn.GLU
Strategy: Direct Mapping
Official Docs ↗

Flax NNX

API: flax.nnx.GLU
Strategy: Direct Mapping
Official Docs ↗