Green was the first black man to own a house; it might be marked as part of history