I think there is a place for rich text and compact binary formats. Then can pre-render from complicated source to produce smaller and faster binary format. You would edit the SVG and then make TinyVG (and minified SVG).

SVG is weird among image format in that it is XML. It requires a lot of effort to parse and render.