LiveFR

Learning rate

Definition: The learning rate controls how large each parameter update is during training: large to learn fast, small to learn finely.

Too high, training diverges; too low, it becomes slow and can stall. It is one of the most sensitive settings in deep learning.

See also

← Full AI glossary · AI news