Not working in the field I don't know relevance, but I thought that the "4D Gaussian Splatting"[0] looked like it makes great efficiency gains.

[0] https://news.ycombinator.com/item?id=37905601