Why Attention Breaks Down and What Actually Helps