Free Speech, Hate Speech & Terroristic Threats

Where do we draw the line? Biden seemed to equate something called "hate speech" with evil. Well, he might be right but is it illegal? Frankly, I would rather have someone be straight with me rather than hide their agenda. However, when it becomes a threat to my safety, that is something different.