In this tutorial, you will learn how to use Keras to train a neural network, stop training, update your learning rate, and then resume training from where you left off using the new learning rate. Using this method you can increase your accuracy while decreasing model loss. Today’s tutorial is inspired by a question I […]
Tag Archives | learning rates
Keras Learning Rate Finder
In this tutorial, you will learn how to automatically find learning rates using Keras. This guide provides a Keras implementation of fast.ai’s popular “lr_find” method. Today is part three in our three-part series of learning rate schedules, policies, and decay using Keras: Part #1: Keras learning rate schedules and decay Part #2: Cyclical Learning Rates […]
Cyclical Learning Rates with Keras and Deep Learning
In this tutorial, you will learn how to use Cyclical Learning Rates (CLR) and Keras to train your own neural networks. Using Cyclical Learning Rates you can dramatically reduce the number of experiments required to tune and find an optimal learning rate for your model. Today is part two in our three-part series on tuning […]
Keras learning rate schedules and decay
In this tutorial, you will learn about learning rate schedules and decay using Keras. You’ll learn how to use Keras’ standard learning rate decay along with step-based, linear, and polynomial learning rate schedules. When training a neural network, the learning rate is often the most important hyperparameter for you to tune: Too small a learning […]