'The problem is not the voters, the problem is us,' admits Dem midterm chief