Freedom of association is extremely limited once you factor in public accommodations. For example, even if I own a hotel, I can’t choose who can stay in the hotel if they are willing to pay in a lot of cases.