Philip Schofield says he has "lost everything"