Think Twice on Oversimplified Advice