Men are 'entitled to male-only spaces'