Richard Fowler says race played a role in Alexi McCammond's ouster