Ex-Trump defense chief: Pelosi should go to Taiwan if she wants