Harry and Meghan spending MORE time AWAY from Archie and Lili!