I think the world would be a hugely better place if everyone would only eat animals from neighbours' hobby farms. That said, it's a slippery slope in practise. Usually people who argue using these special circumstances then continue to argue that "local farms" are magically ethical, because they're non-factory farms. Then in real life these people actually eat non-local meat and factory farmed meat.

The point of non-speciesism is that it's not automatically ethical to eat animals even if they're not in horrendous factory farms. You're still treating non-humans in a separate ethical category.

An additional point to make is that even if something appears ethical, it often is not. Usually hobby farm chickens are sourced from unethical places, for example. Of course there's no point in talking about this particular hobby chicken farm because nobody else knows anything about it.