Pollster Richard Baris says Republicans were disproportionally impacted by Election Day issues