PipelinedTransformer

A pipelined Transformer layer.

Abstract Signature:

PipelinedTransformer(model_dims: int, num_layers: int)

PyTorchKerasApple MLXFlax NNXPaxML / Praxis

PyTorch

API: —

Strategy: Custom / Partial

Keras

API: —

Strategy: Custom / Partial

Apple MLX

API: —

Strategy: Custom / Partial

Flax NNX

API: —

Strategy: Custom / Partial

PaxML / Praxis

API: praxis.layers.PipelinedTransformer

Strategy: Direct Mapping

Official Docs ↗