Police: Arrest prevented act of retaliation