Speaker Pelosi says it is her “right as Speaker” to seat or unseat any member of Congress she wants