He was the slaveholder's worst nightmare