The 1st Amendment also includes freedom of assembly. The ability of the state to know who is privately associating with whom conflicts with the 1st and 14th.

http://en.wikipedia.org/wiki/National_Association_for_the_Ad...