VisionTransformer

Vision transformer model.

Abstract Signature:

VisionTransformer(entry_layers_tpl)

PyTorchPaxML / Praxis

PyTorch

API: torchvision.models.VisionTransformer

Strategy: Plugin (vit_constructor)

PaxML / Praxis

API: praxis.layers.VisionTransformer

Strategy: Direct Mapping

Official Docs ↗