Jess Phillips says the women do not need to go to the police who made the accusations