But where do you draw the line?

In a free society there should be no line. A person should be free to say absolutely anything. There is certainly a possibility of causing harm by way of your speech, but this should be handled post hoc, with a court determining damages.

America partially observes this with a watered-down doctrine of prior restraint, but it's got enough exceptions that it's not worth so much.