They refused to go inside their apartments, now they say they are being threatened with evictions