"If you were to declare one party criminal and illegitimate, you'd be left with a one-party state