Families say HOA drove them out