'Most people wanted peaceful protests, agitators didn't,' Akron pastor says