Podman beeing mostly compatible with docker was a wise choice. If you run rootless no way to break fw/network like docker can.

With podman in mind, one ought to try buildah and skopeo. Again, buildah can run Dockerfiles, but you are not constrained to the weird Dockerfile syntax.