CubedReLU

Activation: max(0, x)^3.

PyTorchPaxML / Praxis

PyTorch

API: —

Strategy: Macro 'lambda x: torch.relu(x)**3'

PaxML / Praxis

API: praxis.layers.CubedReLU

Strategy: Direct Mapping

Official Docs ↗