LoRALinear

A Linear layer with built-in LoRA adaptation.

Abstract Signature:

LoRALinear(in_features: int, out_features: int, lora_rank: int = 8, bias: bool = True)

PyTorchKerasTensorFlowApple MLXFlax NNXPaxML / Praxis

PyTorch

API: —

Strategy: Custom / Partial

Keras

API: —

Strategy: Custom / Partial

TensorFlow

API: —

Strategy: Custom / Partial

Apple MLX

API: —

Strategy: Custom / Partial

Flax NNX

API: flax.nnx.LoRALinear

Strategy: Direct Mapping

Official Docs ↗

PaxML / Praxis

API: —

Strategy: Custom / Partial