Pay Attention Or Pay The Price