Concerns grow after decision not to build homes