Rishi Sunak has had a pretty rough first week as Prime Minister.