I have very similar setup https://github.com/dejanr/dotfiles it was inspired by https://github.com/peel/dotfiles and few other repositories.

Also i still symlink some stuff like stow is doing, but with few shell scripts. The main difference is that my dotfiles are not start with '.'.

Idea is to move everything to nix, so that when you rollback, you rollback your dotfiles as well.

What i wish maybe, is that i used home manager but that some future focus.