More like: "When it's down, it's just down for everyone and there's nothing you can do"

If most messaging systems were IRC, XMPP or Matrix then and the status quo was not that Facebook Messenger and Whatsapp were the most popular instant messaging solutions, then Signal being so centralised would look quite odd and we might have cause to criticise them.

The situation is not that, however we can still fault them for this.