Mason Tappan denounced the Democratic Party for being "an ally of slavery"