Knowing Yourself is Harder Than You Think