LossScaleOptimizerΒΆ

An optimizer that dynamically scales the loss to prevent underflow.

Abstract Signature:

LossScaleOptimizer(inner_optimizer, initial_scale: float = 32768.0, dynamic_growth_steps: int = 2000)

Keras

API: keras.optimizers.LossScaleOptimizer
Strategy: Direct Mapping

TensorFlow

API: tf.keras.mixed_precision.LossScaleOptimizer
Strategy: Direct Mapping