The Firm 'concerned' over Royal return of Prince Andrew