You're conflating freedom from government suppression and freedom from social consequences. Free speech refers to, and only to, the former.