MakeCausalMask

Creates causal mask for self-attention.

Abstract Signature:

MakeCausalMask(x: Tensor)

PyTorchFlax NNX

PyTorch

API: torch.nn.attention.bias.causal_upper_left

Strategy: Plugin (causal_mask_adapter)

Flax NNX

API: flax.nnx.make_causal_mask

Strategy: Direct Mapping

Official Docs ↗