Denver Residents Displaced, Building Owners Giving Up