TrainablePositionalEmbedding

Generates trainable position embedding for a given 1-d sequence.

Abstract Signature:

TrainablePositionalEmbedding(max_seq_length: int = 10240, embedding_dims: int = 0)

PyTorch

API: torch.nn.Embedding
Strategy: Direct Mapping
Official Docs ↗

Flax NNX

API: flax.nnx.Embed
Strategy: Direct Mapping
Official Docs ↗

PaxML / Praxis

API: praxis.layers.TrainablePositionalEmbedding
Strategy: Direct Mapping
Official Docs ↗