The GA House recently voted to remove Brad Raffensperger from the State Election Board