The Harris campaign has one fear, former Clinton adviser warns