'I Actually Lost White Population in My Community'