As the learning rate is one of the most important hyper-parameters to tune for training convolutional neural networks. In this paper, a powerful technique to select a range of learning rates for a neural network that named cyclical learning rate was implemented with two different skewness degrees. It is an approach to adjust where the value is c…
neural-network
clr
cnn
range
hyperparameters
learning-rate
expense
cyclical-learning-rates
epochs
learning-rates
clr-policies
skewness-degrees
-
Updated
Jan 19, 2019 - Jupyter Notebook