The man addressed the allegations on TikTok, saying he was not the driver