President Trump told Speaker Mike Johnson to start his term from November 5th