QuantizedAllToShardedLinearΒΆ
Quantized distributed linear layer.
Abstract Signature:
QuantizedAllToShardedLinear(in_features: int, out_features: int)
PyTorch
API:
βStrategy: Custom / Partial
Quantized distributed linear layer.
Abstract Signature:
QuantizedAllToShardedLinear(in_features: int, out_features: int)
β