‘I’m afraid today is a day about breaking promises to Brexit voters’