FeedForwardΒΆ

Feedforward layer with activation (usually Linear -> Act -> Linear).

Abstract Signature:

FeedForward(in_features: int, out_features: int, hidden_dims: int, activation: str = relu)

PyTorch

API: β€”
Strategy: Custom / Partial

Keras

API: β€”
Strategy: Custom / Partial

Flax NNX

API: β€”
Strategy: Custom / Partial

PaxML / Praxis

API: paxml.layers.FeedForward
Strategy: Direct Mapping