Trey Gowdy: GOP voters need to demand answers for midterm performance