Steve Hilton says controlling immigration has nothing to do with 'prejudice or xenophobia'