Adagrad

Adagrad Has a Learning Rate

Adagrad requires a learning rate, and why that can be a good thing.