Residents voice concern over housing plan