Man accused of sexual battery is not surprising to neighbors