Community improvement, not displacement, is the goal of turning old blanket factory into affordable apartments