Taylor Swift has learned she can't control people's interest in her personal life