Even the Muslims are pushing back