warmupLearnRate
Description
A warm-up learning rate schedule object ramps up the learning for a specified number of iterations.
Tip
To easily use a warm-up learning rate schedule with the default options, set the
LearnRateSchedule
argument of
the trainingOptions
function to "warmup"
.
Creation
Description
creates a
schedule
= warmupLearnRatewarmupLearnRate
object.
This syntax is equivalent to setting the LearnRateSchedule
argument of
the trainingOptions
function to
"warmup"
.
specifies additional properties using
one or more name-value arguments. For example, schedule
= warmupLearnRate(Name=Value
)InitialFactor=0.5
specifies an initial scaling factor of 0.5.
Properties
Examples
Algorithms
Version History
Introduced in R2024b