Neighbours claim they are 'distressed' over Home Office plans