Ex-Trump aide says group is meeting to stop him in 2024