More Republicans are defecting from McCarthy.