My understanding is that under EU treaties, EU countries are obliged to treat companies formed in other countries the same as local companies, i.e. the government can't discriminate against you for having a company registered somewhere else.

Indeed many EU startups are officially headquartered in the UK even if they're based elsewhere in Europe for the favourable legal and tax implications.