Anti-Trump Republican says party is now 'panicking' following candidate switch