LossScaleOptimizerΒΆ
An optimizer that dynamically scales the loss to prevent underflow.
Abstract Signature:
LossScaleOptimizer(inner_optimizer, initial_scale: float = 32768.0, dynamic_growth_steps: int = 2000)
An optimizer that dynamically scales the loss to prevent underflow.
Abstract Signature:
LossScaleOptimizer(inner_optimizer, initial_scale: float = 32768.0, dynamic_growth_steps: int = 2000)