Barrier Island residents told it's time to leave