Why is the learning rate for the bias usually twice as large as the the LR for the weights?
Show older comments
Why is the learning rate for the bias usually twice as large as the the LR for the weights?
2 Comments
Greg Heath
on 4 Jan 2018
Please post the proof of this assertion.
Greg
Salma Hassan
on 5 Jan 2018
Edited: Image Analyst
on 5 Jan 2018
Answers (0)
Categories
Find more on Deep Learning Toolbox in Help Center and File Exchange
Products
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!