As it grows, it simply drives you insane by how many technical trivialities you need to keep in your head to keep it working smoothly

For everything else there's Ansible.

We've taken the approach to not type a single command into a live server's console and use CM tools to document and automate. This, along with well written operating documentation can be invaluable.