Yes, precisely. If you have the freedom to do only things that absolutely no one else could take offense from then you do not have freedom.