Problem 15 - Olympiad

In a recurrent neural network, what problem does the long short-term memory (LSTM) cell primarily solve?

A. Vanishing and exploding gradients in long sequencesB. Overfitting in convolution layersC. Slow GPU memory allocationD. Need for very high learning rates

Correct: A

LSTM uses gating mechanisms and a cell state highway to allow gradients to flow unchanged over many time steps, mitigating vanishing gradients.