QuantizedShardedToAllLinearΒΆ
Quantized distributed linear layer (gather).
Abstract Signature:
QuantizedShardedToAllLinear(in_features: int, out_features: int)
PyTorch
API:
βStrategy: Custom / Partial
Quantized distributed linear layer (gather).
Abstract Signature:
QuantizedShardedToAllLinear(in_features: int, out_features: int)
β