McCarthy 'not at all' worried about losing gavel