"I'm not going anywhere", said Joe Biden, before leaving the White House