Omar says others trying to "eliminate public voice of Muslims"