Alpha (α) is the parameter for learning rate.

Learning rate represents the speed at which a machine learning model “learns”.

Example

Model with alpha at 0.001 learns faster than a model with alpha at 0.0001.

If the alpha is too low, the model will learn too slowly. If the alpha is too high, the model will learn too quickly and become unstable.

Further readings

Interactive demos