I don't think it's silly. I don't boycott companies -- that is, I don't stop doing business with companies in an attempt at getting them to change their behavior.

However, there are companies that engage in activities that I find objectionable enough that I simply don't want to help fund them. So I don't buy from those companies. Nothing silly about it.