Stephen Moore says 'sleaze campaign' forced him to withdraw from the Fed process